Ayush Jain
Product Lead | Consumer Platforms, Payments & Monetization | Microsoft, Bolt | Building Products at Global Scale
About
Across organizations, the pattern in my work has been that I get hired to ship product but I rather build the Operating System which makes the function deliver the outcomes. With Microsoft's Product Management team I built the intelligence platform needed for engineers to pick the signals from the noise of high volume feedback (on MS Teams product) using LLMs, Agents and Orchestration. Setup the OKRs and KPI frameworks, Eval governance for production AI & the Analytics infrastructure. At Bolt I was Head of New Users vertical in Ride Hailing business, a 13-person cross-functional team across 50+ countries and 150M+ users; delivered a +11pp activation lift and € nine figure in incremental annual GMV, highest in the team's history. Before this, I built and launched products for - RummyCircle (part of Games24x7), - Aetna Insurance (part of CVS Health), I have built products and features for users in the US, India, Europe & Africa. Have extensive experience in data-driven B2C products, and AI transformation across Consumer Tech, Gaming and Enterprise tech domains. Email: ayushjkjain at gmail dot com
Work Experience
2024 - 2026 (2y)
• Led product strategy for MS Teams’ Feedback Intelligence platform - a production Gen AI decision-intelligence system processing XXK+ monthly engineering feedback reports through LLMs, RAG orchestration, multi-agent workflows on Semantic Kernel, and embedding-based vector search - converting heterogeneous telemetry into routing, deduplication, and RCA decisions at enterprise scale. • Built the function’s operating system: authored OKRs and KPI framework with clear baselines and goals for routing, deduplication, fix rate, and time-to-mitigation; used by leadership to evaluate AI investment decisions. • Delivered the engineering-efficiency outcomes that defined the platform’s success: routing accuracy (+XX%), automated duplicate identification (+XX%), issues fixed (+XX%), and time-to-fix (-XX days) - outcomes attributable to product decisions on AI architecture, eval design, and prompt governance. • Designed the eval and governance framework for the LLM stack - offline replay, shadow mode, regression gates, and human-feedback loops - ensuring AI quality improvements were auditable and that prompt or model changes never regressed production engineering metrics.
2021 - 2024 (3y)
• Product Leader of Rides New Users vertical of Bolt’s ride-hailing business - a 13-person cross-functional team of engineers, designers, and analysts spanning 50+ countries and 150M+ users. Owned the investment ROI case for the vertical - incremental GMV against fully-loaded team cost, the formal input to semester-by-semester headcount allocation across the company - delivering 8x ROI. • Designed and executed the New Users Strategy that lifted activation rate by +11pp and delivered €XXX Million+ in incremental annual GMV - the highest cumulative impact in the New Users team’s history and ~41% of the parent RiderX group’s contribution. • Built the analytics and experimentation operating system for the vertical from a state where critical funnel performance data was unavailable - defining the Visitor ID auth-type for randomized experimentation, the AB scorecard metrics, and the impact-analysis discipline. • Led multi-quarter, multi-team initiatives spanning Rider, Driver, Marketplace, Identity, Commerce, Comms, Compliance, and Country teams - including Multiple Stops (+0.X% GMV/user, +0.XX% finished trips/user), Smart Pickups (−0.X% wait time, −0.X% cancellations), Pre-Auth improvements (€XXM+ annual GMV), and Pickup Notes (−0.X% cancellations, −0.X% no-shows). • Drove product decisions for market expansion into Thailand, Spain, and Barcelona - partnering with country and compliance teams to navigate regulatory differences across pricing transparency and identity. Launched country-specific payment integrations: Mobile Money (Africa), Google Pay (Global), BLIK (Poland), iDeal (Netherlands), Swish (Sweden).
2019 - 2021 (2y)
Product Management at RummyCircle (Real Money Game by Games24x7). Games24x7 is India's most successful gaming business with a full-stack portfolio of Skill Games and Casual Games! Leading a team of 2 PMs for the following portfolios. Withdrawal Acceleration: • Building features to accelerate the withdrawal process and workflow for identified user cohorts for overall retention improvement. • Improving the Cash Withdrawal Process for the players with the objective of improving the players' withdrawal rate, retention and revenue. • KPIs impacted: Withdrawal Attempts, Withdrawal Success Rate, D30 ARPU, D30 Retention. $XXM revenue gain. Signup and Login Improvements: • Revamping Signup and Login experience for users via iterative A/B experiments. • KPIs impacted: Install to Registration XX%, Registered Users to Paid Users Converts XX%. Payments Initiative: • POC for all payment partnerships. Executed a series of improvements leading to success rate improvement of XX%. • Partnered with best in payments industry companies to further improve our payment experience leading to additional revenue of $XXM. • Built the in-house transactions router to get the best success rate among all our payment partners. Up-skilling Initiative: • Building features with the objective of up-skilling (training on key aspects of the game) the players; built on top of a Data Science model which analyses the gameplay of the identified best players on the platform. • Expert Tips are showcased to the users at the calculated intervention points, leading to improvement in gameplay. • KPIs impacted: Win rate, D30 Retention, D30 ARPU, Drop Adherence. $XXM revenue gain over the year.
2018 - 2019 (1y)
Responsible Gaming Initiative: • Using a Data Science model, identifying the risky players who are addicted to the game and are playing beyond their means. • Taking them through an alternate product journey and getting them through psychological counselling, modifying gameplay experience for them leading to alleviating their risk to themselves. • KPIs Impacted: Fill rate of the intervention journey. Reduction in false positives. $XXM revenue saved annually.
