A functional prototype for this idea is still WIP which will be available soon in my GitHub and uploaded to Streamlit Cloud. However, I’m sharing the idea here.

Background Link to heading

This idea was an inspiration that came from my wish of upskilling myself to a senior data scientist. I was asking myself “what do I need to learn to be a senior data scientist?”. I was thinking about the skills and knowledge that are required to be a senior data scientist and I was thinking about how I can learn them. And what if I can make data driven decisions to understand this based on the current job market in my area?

Method Link to heading

1. Get Job descriptions titled ‘Senior Data Scientist/ AI engineer’ etc from job listing websites.
2. Use NLP with LLM to extract the skills and knowledge required for the job.
3. Cross reference the skills and knowledge with my current skills and knowledge.
4. Use LLM with web search to find me learning resources that are relevant to the skills and knowledge that I need to learn.