Skip to content
CoMLRL
Documentation

Environments

Environments that simulate real-world tasks for training and evaluating LLM collaboration:

  • Writing: Multiple LLM agents collaborate to process articles.

    • TLDR - Summarizing Reddit posts.
    • arXiv - Expanding abstracts into introductions.
  • Coding: Collaborative code generation for programming problems.

    • MBPP - Mostly basic Python problems.
    • HumanEval - Handwritten evaluation problems.
    • CoopHumanEval - A cooperative variant of HumanEval.
  • Travel: Collaborative travel planning under user constraints.

  • Tool-Use: Collaborative function calling on BFCL v4.

    • Native Parallel - Making parallel function calls.