Skip to content
Edition
Late EditionM.S. Computer Science · 3.97 GPA
The Sreekaran Reddy Portfolio
Back to Projects
Data Analytics

Market Pulse: Live Job Market Intelligence Platform

Key finding

An automated pipeline turns job postings into computed statistics and AI summaries; generated text needs verification.

Objective

Built and deployed a live job market intelligence platform that combines a scheduled daily data pipeline with a dual-transport MCP server layer. The pipeline classifies daily job postings from the Adzuna and RemoteOK APIs by role, seniority, and skills into a PostgreSQL and SQLAlchemy schema, running unattended via GitHub Actions and Docker on Render. On top of that foundation, a FastMCP-based MCP server exposes five job-market analytics tools over local stdio and remote streamable HTTP, secured with bearer-token authentication and per-IP rate limiting, with a Groq-powered LLM layered on top to translate the computed statistics into a plain-English market summary based on those statistics. Generated summaries can contain errors and should be checked against the underlying results.

Association
Independent portfolio project
Role
Data Analyst / Data Engineer
Focus
Tracking trends in daily job postings for Data Analyst, BI Developer, Analytics Engineer, and Applied AI roles
Data Sources
Adzuna and RemoteOK job listing APIs, refreshed daily
Status
Fully built and live-deployed, running on a daily automated schedule
  • Python
  • FastAPI
  • PostgreSQL
  • Docker
  • FastMCP
  • Groq API

Part 1

Data Pipeline & Schema Design

Engineered a PostgreSQL and SQLAlchemy schema to classify daily job postings from the Adzuna and RemoteOK APIs by role, seniority, and skills, turning scattered real hiring data into a structured, queryable foundation.

Part 2

Data Coverage & Interpretation

The analysis describes postings collected from Adzuna and RemoteOK, not a representative census of the hiring market. Counts refer to listings, not confirmed hires or necessarily distinct vacancies. Source coverage, duplicate listings, missing salary fields, and collection timing can affect comparisons. Salary and skill summaries should be interpreted within the collected sample and its time window.

Part 3

Automation & Deployment

Automated the ingestion-to-aggregation cycle with GitHub Actions and containerized the service with Docker, deploying it on Render to run continuously without manual intervention.

Part 4

Dual-Transport MCP Server

Refactored shared query logic into a standalone module and built a dual-transport MCP server on top of it using FastMCP, exposing five job-market analytics tools over local stdio and remote streamable HTTP mounted on the existing FastAPI app.

Part 5

Security & AI-Powered Summaries

Secured the remote HTTP transport with bearer-token authentication and a per-IP rate limiter, and layered a Groq-powered LLM summary on top of the computed statistics to translate raw hiring trends into a plain-English narrative based on those statistics. Generated summaries can contain errors and should be checked against the underlying results.