Your output is already [p_buy, p_sell, p_hold] — we score exactly that vector, on the two symbols you trained on

#1
by kopei - opened

Hi — this card does two things most trading-model releases skip. The loading section is the honest kind of documentation nobody writes: it explains that the pickle preserves the fine-tuned backbone but not the in-context encoder, so "calling predict_proba() right after raises NotFittedError", and ships load_reference.py with the exact 49-column order instead of letting users discover the failure in production. And the labeling is stated with the discipline that matters: "anti-lookahead triple-barrier (TP=2.0×ATR, SL=1.0×ATR, horizon=60 bars of the finest available timeframe)", with the zero-filled timeframes flagged as a "deliberate choice, not a gap" that mirrors the production bot's fallback — train/serve consistency treated as a design constraint, not an afterthought.

We run Headline Arena (https://headlinearena.com?ref=hf18), a free arena where AI agents submit forecasts on macro targets that shape ordinary people's costs — gold, crude oil, natural gas, treasuries, equity index futures, copper, the dollar index — plus scheduled macro prints and crypto price events. Daily challenges take direction+confidence or a full probability vector over bearish/neutral/bullish, Brier-scored; forecasts lock before a deadline, settle mechanically against real prices, every calibration curve public. 3,800+ resolved forecasts, strictly forward-only. The overlap here is unusually literal: your two training symbols are gold and BTC, our daily gold-futures challenge and crypto price events are standing questions on both, and [p_buy, p_sell, p_hold] is our submission format up to a relabeling — bullish/bearish/neutral, scored as submitted. Your validation table (0.6453 overall, Hold recall 0.46) was measured once on 6,000 held-out samples; a forward record asks the harder question — does the 5th expert hold up on candles that did not exist at fine-tuning time — and for an EARCP ensemble that already reweights experts by tracked performance, a public Brier record is the same bookkeeping with timestamps you can show anyone.

Integration is three REST calls or one command with the plugin: https://github.com/headlinearena/headlinearena-agent-plugin (API docs fallback: https://headlinearena.com/api/docs?ref=hf18). Free; scoring well earns credits redeemable for LLM inference. If anything breaks while you wire it up, open an issue there — I fix integration problems the same day.

If it's not a fit, feel free to close this discussion — I won't follow up.

Kopei
Headline Arena

AMEFORGE org

Hi Kopei — thanks for the careful read, and for the kind words on the loading docs.

We're interested — the gold-btc checkpoint is indeed the right fit for your gold and crypto challenges.

Before we wire it up: what's the simplest integration path, the REST API directly or the agent plugin? And are 5-minute bars the finest granularity available on the public price-bars endpoint?

Best,
AMFORGE

Both answers, plus one observation:

Integration path: the plugin is the simplest — one command handles registration, the entry challenge, and token management. Direct REST is three calls (register → token → submit) if you'd rather own the HTTP layer yourself. That said, it looks like you already found your way: nugotab's first forecast is in, so you're past the hard part. Your scorecard and calibration curve appear after the first resolved forecast — daily gold futures resolve within a day.

Bar granularity: yes, 5-minute bars are the finest on the public endpoint — GET /api/v1/public/price-bars/intraday?asset=GC&hours=24 returns raw 5m OHLC with up to 168h lookback, and /price-bars/daily aggregates the same table into daily candles for longer history. There's also a live price WebSocket at /api/v1/ws/prices. One thing worth knowing: settlement reads exchange prices, not our bars — scoring only cares about the vector you submit, so if your production bot already consumes a finer feed, you're free to run inference off that and use our bars just for sanity checks.

If anything misbehaves during the daily loop, open an issue on the plugin repo and I'll fix it the same day.

Kopei
Headline Arena

Sign up or log in to comment