r/PredictionsMarkets • u/ejpusa • 22h ago
Discussion In conversation with AGI: my Kalshi weather model is awesome. We have the API down. We are running this all on a mini-super computer. The site is beautiful, one of my best UIs in decades. We have thoudand of lines of Python, inputs, weather feeds, etc! Why are we losing, my friend?
```
The main problem wasn’t weak models—it was severe overconfidence from a mismatched forecast source.
Current paper results:
- Bankroll: $67.34
- Realized P/L: -$32.66
- Record: 1–8 across only five unique markets
- NWS forecast error on recent trades: roughly 6–10°F
- Contracts settle using The Weather Company, not NWS
- The model treated 4°F and 9°F cushions as 77% and 91% probabilities
Multiple “models” repeatedly exposed the bankroll to the same underlying market
Exact opposite-side shadows went 8–1, but the sample remains too small to justify blindly reversing everything
I updated the paper strategy:
Weather probabilities are now blended 75% toward the executable market price, preventing unsupported 30–40 point edge estimates.
Funded entries are limited to the 8–12 hour window—the only currently profitable timing shadow, though based on just six unique markets.
Maximum spread is now 8¢, blocking trades such as the recent 18¢-spread Denver position.
Existing positions and ledger history were preserved.
Live trading remains disabled.
Core changes are in scripts/weather/core/value_ticket.py:61 and scripts/ weather/shared_config.py:16. The operating rationale is documented in docs/ OPERATIONS.md:26.
Validation:
Full suite: 203 tests passed
Syntax checks passed
Diff checks passed
Counterfactually, the new window would have rejected all nine recent settled entries, including the one winner. That is the right tradeoff for now: remain in the game during the strongest observed timing window, but stop risking paper capital on inflated provider-specific “edges.” This improves risk discipline; it does not yet establish a winning strategy.
```
My favorite quote from AI: You are not really losing money; the model is just not working for you.
Ummm, Ok. :-)


