Tejas Sanjaykumar Pagare
Param Rathour (190070049)
4-6
"The project will involve implementing various Economics problems as a Markov Decision Process in a compact way as Gym (https://arxiv.org/abs/1606.01540). Later we will implement Bandit and Reinforcement Learning algorithms to solve these problems. Some economic problems that we will deal with include Matching Markets, Auctions, and allocation problems. Matching Markets has applications in ridesharing, online dating, job matching, kidney exchange, and university applications. Auctions are everywhere, from IPL team selection to online advertising, spectrum allocation to art auctions, government procurement, and online marketplaces.
This project if successful can result in a research paper.
Resources
Markov Decision Processes: https://youtu.be/2iF9PRriA7w
Auctions: https://youtu.be/4kWuxfVbIaU
Matching Markets: https://youtu.be/ELC7rCBL7I0, https://youtu.be/80QZ0IrQVbQ
Economics of Matchmaking: https://youtu.be/kj2fpM57Z7A
Advanced Resources
Michael Jordan Talk: https://youtu.be/fwOZbhQpbNg"
Prereqs: Familiarity with Python. Knowledge of Probability, Statistics. Prior knowledge of Machine Learning and Economics will be helpful.
Week Number | Tasks to be Completed |
---|---|
Week 1-2 | Learn about different types of MDPs, Bandit Algorithms, and some RL algorithms |
Week 3 | Basic familiarity with Gym implementation and GitHub setup. |
Week 4 | Introduction to different Economics Problems and their mathematical models |
Week 5 | Implementating Econ problem as a Gym Environment |
Week 6-7 | Integrating Bandit or RL Algorithms |
Week 8 | Benchmarking against Heuristic Approaches |