I am currently an applied researcher at Expedia Group, where I develop machine learning algorithms for complex problems in marketing and advertising domains such as real-time bidding in Google Hotel Ads. I have a Ph.D. in Electrical Engineering and Computer Science (EECS) from the University of California, Merced. In my Ph.D. dissertation, I studied methods for learning representations in reinforcement learning as well as numerical optimization methods based on quasi-Newton approach for deep learning and deep reinforcement learning applications. See my publications for more information.
[17] Jacob Rafati, and Roummel F. Marcia (2020). Quasi-Newton Optimization Methods For Deep Learning Applications. Published as a chapter in Deep Learning Applications book, Springer.
[bibtex] [pdf] [abstract] [springer][16] Jacob Rafati, and David C. Noelle (2019). Efficient Exploration through Intrinsic Motivation Learning for Unsupervised Subgoal Discovery in Model-Free Hierarchical Reinforcement Learning. arXiv e-print (arXiv:1911.10164).
[bibtex] [pdf] [abstract][15] Jacob Rafati, and David C. Noelle (2019). Learning sparse representations in reinforcement learning. arXiv e-print (arXiv:1909.01575). Under Review.
[bibtex] [pdf] [abstract][14] Jacob Rafati. (2019). Learning Representations in Reinforcement Learning. Ph.D. dissertation. University of California, Merced. USA.
[bibtex] [pdf] [UC-open-access] [slides (pdf)] [slides (keynote)][13] Jacob Rafati, David C. Noelle. (2019). Unsupervised Subgoal Discovery Method for Learning Hierarchical Representations. In 7th International Conference on Learning Representations, ICLR 2019 Workshop on "Structure & Priors in Reinforcement Learning", New Orleans, LA, USA.
[bibtex] [pdf] [code] [slides] [poster] [project website][12] Jacob Rafati, David C. Noelle. (2019). Unsupervised Methods For Subgoal Discovery During Intrinsic Motivation in Model-Free Hierarchical Reinforcement Learning. In 33rd AAAI Conference on Artificial Intelligence (AAAI-19). Workshop on Knowledge Extraction From Games. Honolulu, Hawaii. USA.
[bibtex] [pdf] [slides] [proceeding] [ceurws-paper] [keg19-paper] [keg19-list] [code] [project website][11] Jacob Rafati, and David C. Noelle (2019). Learning Representations in Model-Free Hierarchical Reinforcement Learning. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI-19). 33(01), 10009-10010. Honolulu, Hawaii.
[bibtex] [pdf] [poster] [proceeding] [doi] [supplementary][10] Jacob Rafati, and Roummel F. Marcia (2019). Deep Reinforcement Learning via L-BFGS Optimization. arXiv e-print (arXiv:1811.02693).
[bibtex] [pdf] [abstract][9] Jacob Rafati, and David C. Noelle (2019). Learning Representations in Model-Free Hierarchical Reinforcement Learning. arXiv e-print (arXiv:1810.10096).
[bibtex] [pdf] [abstract][8] Jacob Rafati, and Roummel F. Marcia (2018). Improving L-BFGS Initialization For Trust-Region Methods In Deep Learning. In 17th IEEE International Conference on Machine Learning and Applications (ICMLA 2018), Orlando, Florida.
[bibtex] [pdf] [proceeding] [ieee-abstract] [doi] [sildes] [project website] [code][7] Jacob Rafati, Omar DeGuchy and Roummel F. Marcia (2018). Trust-Region Minimization Algorithm for Training Responses (TRMinATR): The Rise of Machine Learning Techniques. In 26th European Signal Processing Conference, Rome, Italy.
[bibtex] [pdf] [proceeding] [ieee-abstract] [doi] [project website] [code][6] Jacob Rafati and David C. Noelle (2017). Sparse Coding of Learned State Representations in Reinforcement Learning. In Cognitive Computational Neuroscience Conference, Newyork City, NY.
[bibtex] [pdf] [poster] [ link ] [project website] [code][5] Jacob Rafati and David C. Noelle (2015). Lateral Inhibition Overcomes Limits of Temporal Difference Learning. In 37th Annual Cognitive Science Society Meeting, Pasadena, CA, USA.
[bibtex] [pdf] [poster] [link] [project website] [code][4] Jacob Rafati, Mohsen Asghari and Sachin Goyal (2014). Effects of DNA Encapsulation On Buckling Instability of Carbon Nanotube based on Nonlocal Elasticity Theory. In Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2014), Buffalo, New York, USA.
[bibtex] [pdf] [doi] [link][3] Mohsen Asghari, Jacob Rafati and Reza Naghdabadi (2013). Torsional instability of carbon nano-peapods based on the nonlocal elastic shell theory. Physica E: Low-dimensional Systems and Nanostructures, 47:316-323.
[bibtex] [pdf] [doi] [link][2] Mohsen Asghari, Reza Naghdabadi and Jacob Rafati (2011). Small scale effects on the stability of carbon nano-peapods under radial pressure. Physica E: Low-dimensional Systems and Nanostructures, 43(5):1050-1055.
[bibtex] [pdf] [doi] [link][1] Mohsen Asghari and Jacob Rafati (2010). Variational Principles for the Stability Analysis of Multi-Walled Carbon Nanotubes Based on a Nonlocal Elastic Shell Model. In 10th ASME Biennial Conference on Engineering Systems Design and Analysis, paper no. ESDA2010-24473, pages 591-598.
[bibtex] [pdf] [doi] [link][0] Jacob Rafati (2010). Stability Analysis of Hybrid Nanotubes based on the Nonlocal Continuum Theories. M.Sc. Thesis. Sharif University of Technology. Tehran, Iran.
[bibtex] [pdf (in farsi)] [link (sharif library)]Apart from being my research in computer science, I have been active as an artist too. My art includes, performeronce art, paintings, installations, video, and interactive arts. You can visit my art website at http://jacobrafati.com for more details.
I enjoy walking in nature. I love coffee and coffeeshops. I mostly lived in cities, Tabriz, Tehran, San Francisco and Seattle. I enjoy playing Poker and mind games. I love adventurous sports such as Bungee jumping. I can speak fulently in 3 languages, English, Azeri and Farsi.