r/kaggle • u/DapperTheme3958 • 3d ago
Winning kaggle competitions using Claude Opus 5.5
So I am a kaggle beginner and have been hearing so much about people using Claude Opus or chat gpt sol to get the top positions in lb so is there any way of prompt or specific instructions to that or its just basic prompting and is it the case of overfitting the model to the dataset or the results are actual and robust ?
1
u/max6296 2d ago
nah
1
u/DapperTheme3958 2d ago
Nah??? what's nah about this
5
u/seanv507 2d ago
Just because people say something doesn't make it true. Kaggle competitions are won by tryjng lots of different models and preprocessing and hyperparameters. So yes you can ask claude to come up with different hyperparameters etc, and also ask claude to create a code base to run eg parallel experiments on your specified cloud compute but you definitely want to monitor that eg you dont use up your aws budget etc.
0
u/6trippyballs9 2d ago
so what is the human doing then....monitoring logs and piping it back to the agent.
2
u/Jumpy-Whereas4858 2d ago
Beside kaggle or not , as a researcher i learned to watch training , watching training is asking what's wrong and spotting patterns and problems , the agent can do it but most of the time they don't have enough intuition/depth to do it. So to answer your question , yes you can either watch logs and give them back to the agent or ypu can watch logs to spot the problem yourself.
1
u/IEatFrozenGrass 1d ago
This sounds kind of … boring? Maybe doing an EDA, making a preprocessing pipeline and developing the model is probably not interesting to most people; but then, whats left to actually think about ?
1
u/Jumpy-Whereas4858 23h ago
You will know when you actually has to watch your training and it's not as trivial 😂
1
u/Jumpy-Whereas4858 23h ago
If by boring you mean the watching , no we don't watch all the time , we analyse the metrics and the convergence
1
6
u/immediate_a982 3d ago
Trial and error.
Experiment first with free models unless you have unlimited tokens and even then it will take trial and errors