Introducing HorizonSWE — Research 01
FlamkiLabs
FLAMKI LABS / PRODUCTS

Engineering work.
Packaged for AI.

Repository-level tasks and evaluation environments for teams building coding agents. Define the capability you want to train or test; we’ll scope the engineering work and the evidence you need.

Discuss your requirements
01 / CUSTOM TASK PROGRAMS

Long-horizon
engineering tasks.

Work that requires an agent to understand a repository, plan a change, implement it across dependencies, and validate the result.

We scope tasks around multi-stage engineering: debugging interacting systems, integrating APIs, and making changes that need more than a local edit.

REPOSITORY REASONINGMULTI-FILE CHANGESTEST-DRIVEN VALIDATION
WHAT YOU RECEIVE
  • 01
    Task specification

    Requirements, starting conditions, and explicit acceptance criteria.

  • 02
    Repository & environment

    A pinned snapshot, dependencies, and setup and reset instructions.

  • 03
    Reference & tests

    A reference patch and regression checks tied to the required behaviors.

  • 04
    Validation record

    Baseline and reference results, with the environment and commands documented.

Available through a scoped pilot

Language, complexity, expected task horizon, and delivery terms are agreed before production.

Scope a five-task pilot
02 / EXECUTION

Reproducible
environments.

Task environments with pinned dependencies, documented resets, and repeatable validation commands. Containerization and supported runtimes are agreed for the engagement.

See our environment criteria
03 / MEASUREMENT

Custom benchmarks
& evaluations.

Evaluation tasks and grading criteria aligned with the capability you need to measure. Reports distinguish task outcomes, execution errors, and resource limits.

See our validation approach
INSPECT THE WORK

Two ways to review
our engineering.

START WITH A PAID PILOT

Five tasks.
A defined delivery.

An initial scope for technical review before expanding production. Custom pricing and a delivery schedule are agreed with you.

Scope
Five original tasks in an agreed language, repository domain, and difficulty range.
Delivery
Specifications, snapshots, environments, reference patches, tests, and validation records.
Acceptance
Baseline failures, passing references, required behavior coverage, and reproducible setup.
Request a pilot scope
THE METHOD BEHIND THE DATA

Designed to be inspected.
Built to be reproduced.

Explore our approach