Source for most of my recent projects is hosted on this GitHub site .

Some older software which I was involved (e.g., during my PhD) may still be available under my personal GitHub site haozhu10015 and the Neurorobotics Group GitHub site.

Recent software

  • dbcp: a CVXPY extension for biconvex programming

  • cvxgenrust: a Python package for generating Rust crates from parameterized CVXPY problems.

  • jemdoc-rs: a Rust rewrite of jemdoc+MathJax for creating websites

  • rlfit: a Python package for fitting reinforcement learning models to behavior data under multi-armed bandits

  • cvxrust: a Rust implementation of disciplined convex programming

  • saferl-lib: a toolkit for constrained reinforcement learning and safe reinforcement learning research

  • dlfm: a framework for fitting discrete latent factor models in Python

  • foils: a light LaTeX class package for generating slides

  • latex-template: LaTex templates for article, slides, book, and poster

Not so recent software

  • cvx_irl: for inverse reinforcement learning via convex optimization

  • hiql: for hierarchical inverse Q-learning