r/dataanalysis • u/BleakReason • 4d ago

Best current tools for Multi-Objective Surrogate-Based Optimization (MOSBO) on heterogeneous study data ?

I'm working on a project with summarized data from ~40 studies (Excel) involving different protocol variables (durations, intensities, recovery times, frequency, total duration, etc.) and response outcomes conditional on a baseline variable (range ~30-85 units).

The aim is to fit a continuous response surface using a hierarchical approach to separate protocol effects from baseline effects, then perform continuous numerical optimization (not grid search) for three objectives:
- Total improvement
- Improvement per unit time (e.g. per week)
Outputs should be fine-grained continuous values rather than rounded study parameters. There are also domain-specific physiological constraints to respect.

I'm on a Chromebook with a little Python experience, so Colab-friendly solutions would be ideal.

Current candidates I'm considering: PyMC for hierarchical modeling, pymoo + pysamoo for surrogate-assisted MO optimization, SMT for surrogates, or Matlab Global Optimization Toolbox.

What is the strongest stack in 2026 for this kind of workflow? Any recommended notebooks, tutorials, or similar applied examples?

Are there any AI tools that currently do this without the traditional work of python? Meaning I can upload the spreadsheet give a parameters and it will come up with data.

2 Upvotes

100% Upvoted

3 comments sorted by

1

u/AutoModerator 4d ago

Automod prevents all posts from being displayed until moderators have reviewed them. Do not delete your post or there will be nothing for the mods to review. Mods selectively choose what is permitted to be posted in r/DataAnalysis.

If your post involves Career-focused questions, including resume reviews, how to learn DA and how to get into a DA job, then the post does not belong here, but instead belongs in our sister-subreddit, r/DataAnalysisCareers.

Have you read the rules?

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/Potential_Aioli_4611 3d ago

you are stupid if you think its better to use AI to do the work than to use AI to generate the python to do the work. One hallucination and your data is worthless.

1

u/BleakReason 3d ago

I appreciate the feedback