Jacob Rafati

Ph.D. Candidate
Electrical Engineering and Computer Science
Computational Cognitive Neuroscience Lab
Univeristy of California, Merced

I am a Ph.D. candidate in the Electrical Engineering and Computer Science program at the University of California, Merced. I am also a member of Dr. David C. Noelle’s Computational Cognitive Neuroscience Lab. I am expecting to defend my dissertation in spring of 2019 and graduate by the end of May 2019. I would like to pursue an academic career path. I am searching to find a Postdoctoral position starting from Summer or Fall 2019.
My research focus is on Optimization, Machine Learning and Reinforcement Learning. I am interested in studying, designing and implementing numerical algorithms for large-scale optimization problems. Currently, I am working on two main projects. (1) My Ph.D. thesis, "Learning Representations in Reinforcement Learning", under the supervision of Dr. David C. Noelle. (2) I am also collaborating with Dr. Roummel F. Marcia -- a faculty of Applied Mathematics at UC Merced -- on Quasi-Newton optimization methods for large-scale machine learning problems, such as deep learning and deep reinforcement learning.

Education

University of California, Merced

Doctor of Philosophy
Electrical Engineering and Computer Science
August 2013 - now

Sharif Univeristy of Technology

Master of Science
Mechanical Engineering
August 2008 - January 2010

Sharif Univeristy of Technology

Bachelor of Science
Mechanical Engineering
August 2003 - May 2007

Publications

2019

[11] Jacob Rafati, and David C. Noelle (2019). Learning Representations in Model-Free Hierarchical Reinforcement Learning. In 33rd AAAI Conference on Artificial Intelligence (AAAI-19), Honolulu, Hawaii.

[bibtex] [abstract] [long version preprint]

2018

[10] Jacob Rafati, and Roummel F. Marcia (2018). Quasi-Newton Optimization in Deep Q-Learning for Playing ATARI Games. arXiv e-print (arXiv:1811.02693).

[bibtex] [preprint]

[9] Jacob Rafati, and David C. Noelle (2018). Learning Representations in Model-Free Hierarchical Reinforcement Learning. arXiv e-print (arXiv:1810.10096).

[bibtex] [preprint]

[8] Jacob Rafati, and Roummel F. Marcia (2018). Improving L-BFGS Initialization For Trust-Region Methods In Deep Learning. In 17th IEEE International Conference on Machine Learning and Applications (ICMLA 2018), Orlando, Florida.

[bibtex] [paper] [project website] [code]

[7] Jacob Rafati, Omar DeGuchy and Roummel F. Marcia (2018). Trust-Region Minimization Algorithm for Training Responses (TRMinATR): The Rise of Machine Learning Techniques. In 26th European Signal Processing Conference, Rome, Italy.

[bibtex] [paper] [project website] [code]

2017

[6] Jacob Rafati and David C. Noelle (2017). Sparse Coding of Learned State Representations in Reinforcement Learning. In Cognitive Computational Neuroscience Conference, Newyork City, NY.

[bibtex] [abstract] [poster] [ link ] [project website] [code]

2015

[5] Jacob Rafati and David C. Noelle (2015). Lateral Inhibition Overcomes Limits of Temporal Difference Learning. In 37th Annual Cognitive Science Society Meeting, Pasadena, CA, USA.

[bibtex] [paper] [poster] [link] [project website] [code]

2014

[4] Jacob Rafati, Mohsen Asghari and Sachin Goyal (2014). Effects of DNA Encapsulation On Buckling Instability of Carbon Nanotube based on Nonlocal Elasticity Theory. In Proceedings of the ASME 2014 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2014), Buffalo, New York, USA.

[bibtex] [paper] [doi] [link]

2013

[3] Mohsen Asghari, Jacob Rafati and Reza Naghdabadi (2013). Torsional instability of carbon nano-peapods based on the nonlocal elastic shell theory. Physica E: Low-dimensional Systems and Nanostructures, 47:316-323.

[bibtex] [paper] [doi] [link]

2011

[2] Mohsen Asghari, Reza Naghdabadi and Jacob Rafati (2011). Small scale effects on the stability of carbon nano-peapods under radial pressure. Physica E: Low-dimensional Systems and Nanostructures, 43(5):1050-1055.

[bibtex] [paper] [doi] [link]

2010

[1] Mohsen Asghari and Jacob Rafati (2010). Variational Principles for the Stability Analysis of Multi-Walled Carbon Nanotubes Based on a Nonlocal Elastic Shell Model. In 10th ASME Biennial Conference on Engineering Systems Design and Analysis, paper no. ESDA2010-24473, pages 591-598.

[bibtex] [paper] [doi] [link]

Projects

Ph.D. Dissertation: Learning Representations in Reinforcement Learning

[abstract] [publications]


Quasi-Newton Optimization Methods in Deep Learning

[abstract] [publications]



News

2019

January 2019. The paper, "Learning Representations in Model-Free Hierarchical Reinforcement Learning" co-authored with Dr. David C. Noelle has been selected for poster presentation in 33rd AAAI Conference on Artificial Intelligence (AAAI-19) in Honolulu, Hawaii for Student Abstract and Poster Program. Congratulations David!

2018

December 2018. The paper, "Improving L-BFGS Initialization For Trust-Region Methods In Deep Learning" co-authored with Dr. Roummel F. Marcia has been accpeted to the 17th IEEE International Conference on Machine Learning and Applications conference (ICMLA 2018) in Orlando, Florida for oral presentation. Congratulations Roummel!

November 2018. I will give a talk in UC Merced EECS Graduate Seminar on November 2nd, 2018 in COB 265 from 12:00 to 1:15 PM. Title: Limited-Memory Quasi-Netwon Optimization Methods in Deep Learning.

August 2018. I am officially a Ph.D. Candidate. Dr. Marjorie S. Zatz, the vice provost and Dean of the Graduate Division congratulated me the advancement to the Ph.D. candidacy.

June 2018. I passed the qualification examination by defending my Ph.D. dissertation research proposal succesfully. The title of my thesis is "Learning Representation in Reinforcement Learning". The Ph.D. commitee members are Dr. David. C. Noelle, Dr. Roummel F. Marcia, Dr. Shawn Newsam, Dr. Marcelo Kallmann and Dr. Jeffrey Yoshimi.

May 2018. The paper, "Trust-Region Minimization Algorithm for Training Responses (TRMinATR): The Rise of Machine Learning Techniques" has been accepted to the 26th European Signal Processing Conference (EUSIPCO 2018), Italy, Rome. Co-authored with Omar DeGuchy and Dr. Roummel F. Marcia.

Experience

Researcher

Computational Cognitive Neuroscience Lab
University of California, Merced

June 2014 - Present

Teaching Assistant

School of Engineering
Univerisity of California, Merced
List of Courses that I helped teaching
  • Introduction to Artificial Intelligence (Java), Fall 2017, Fall 2018.
  • Computational Coginitive Neuroscience (Emergent), Spring 2017, Spring 2018.
  • Computer Organization (C and MIPS Assembly), Spring 2016, Summer 2018.
  • Introduction to Computing I (Java), Spring 2015,Fall 2014. Summer 2018.
  • Engineering Programming (Matlab and Fortran), Fall 2013.
  • Finite Element Analysis, (MatLab and ComSol Lab) Spring 2014.
August 2013 - Present

Skills

Programming Languages
  • Python
  • Matlab
  • Java
  • Bash
  • Javascript
  • C++
Machine Learning Libraries
  • TensorFlow
  • SciPy and Numpy
  • Keras
Workflow
  • Multi-GPU and CPU clusters parallel comupations
  • Cross Platform Pipelining
  • Interdisciplinary and Cross Functional Teams

Interests

Research Interests
  • Machine Learning
  • Large-scale Numerical Optimization
  • Deep Learning
  • Reinforcement Learning
  • Applied Mathematics
  • Dynamical Systems and Control
  • Artificial Intelligence
  • Game Theory
Other Interests

Apart from being a Ph.D. candidiate in computer science, reasercher, developer and teaching assistant, I am a serious artist too. The number of art projects in my art resume is more than the number of research projects in my academic resume. I am a performer, painter and installation artist. You can visit my art website at http://jacobrafati.com for more details.

I enjoy walking in nature. I love coffee and coffeeshops. I mostly lived in cities, Tabriz, Tehran and San Francisco. I like Poker and mind games. I love adventurous sports such as Bungee jumping.

Awards & Certifications

  • Bobcat EECS Summer Fellowship 2018
  • Bobcat EECS Summer Fellowship 2017
  • Bobcat EECS Summer Fellowship 2016
  • Bobcat EECS Summer Fellowship 2014
  • UC Merced EECS Travel Fund 2014
  • UC Merced ME Travel Fund 2014
  • National grant for contribution in the field of Nanotechnology
  • 141th Place in the Iranian National University Entrance Exam among 350,000 Participants
  • 1st Place in Entrance Exam for National Organization for Development of Exceptional Talents (NODET)