Automated Stock Scraper & Analytics ETL Pipeline
Scrapes live and historical equity data, runs it through a Pandas transform layer, and lands it in a structured database. Built this after a class project where I hardcoded ticker symbols and swore I'd never do that again.
// architecture
source → selenium/requests → pandas transform → sql store → signal layer
Rewrote the retry logic twice — first version silently dropped failed requests instead of retrying them. Found out the hard way when a week of data just wasn't there.