Skip to content
View pseudo-rnd-thoughts's full-sized avatar

Organizations

@ray-project @anyscale @Farama-Foundation

Block or report pseudo-rnd-thoughts

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Hey, I'm Mark 👋

Reinforcement Learning Engineer @ Anyscale | Open Source Maintainer | PhD in Deep Explainable RL

🚀 RL Engineer at Anyscale, working on RLlib to scale reinforcement learning from research to production

🏛️ Led maintainer of Gymnasium & Gym — the standard APIs powering RL research worldwide | Core team @ Farama Foundation

🎓 Completed a PhD in Explainable RL at the University of Southampton in 2025 exploring how to explaining agent's decision-making about their future intentions.

Pinned Loading

  1. Farama-Foundation/Gymnasium Farama-Foundation/Gymnasium Public

    A standard API for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly Gym)

    Python 12.6k 1.5k

  2. temporal-reward-decomposition temporal-reward-decomposition Public

    Implementation of "Explaining an Agent’s Future Beliefs through Temporally Decomposing Future Reward Estimators"

    Python 4

  3. Farama-Foundation/Arcade-Learning-Environment Farama-Foundation/Arcade-Learning-Environment Public

    A simple framework that allows researchers and hobbyists to develop AI agents for Atari 2600 games

    C++ 2.5k 478

  4. ray-project/ray ray-project/ray Public

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Python 44k 8.1k