Initializing models from runs, dependency issues #1005

Activity

1. PGijsbers commented on Nov 18, 2020

   

   PGijsbers

   on Nov 18, 2020

   Collaborator

   More actions

   Not being able to reinitialize a scikit-learn 0.21.dev0 model when that package is not installed is intended default behavior.
   However I think we should allow loose reinitialization as we do with the flow_to_model. I created a branch that allows this (loose_initialization). The following code will hopefully allow you to reinitialize the model (provided all dependencies are installed):

   import openml
   tree = openml.runs.initialize_model_from_run(10417577)

   I used a different run as the one you provided had a dependency (hpo4svm) that I did not have installed. Please see if this work on the loose_initialization branch helps you.

   @mfeurer I also noticed there is very little documentation on the scikit-learn extension. We should probably include the Extension interface methods (e.g. flow_to_model).
2. arpasan commented on Nov 18, 2020

   

   arpasan

   on Nov 18, 2020

   Author

   More actions

   Thanks @PGijsbers for answering. That's the exact same code that broke for me earlier though. (And I'm afraid it gives the same kind of an error message.)
   

   Also, why then when I sort for the exact same sklearn I've got, I still get the following <ValueError: Cannot parse dependency sklearn==0.22.2.post1> error? Thanks again!
3. PGijsbers commented on Nov 18, 2020

   

   PGijsbers

   on Nov 18, 2020

   Collaborator

   More actions

   Yes, the code I posted only works when you are working with the loose_initialization branch. I created it specifically because you raised this issue. You can install it from the repo (after a git checkout loose_initialization or with a pip install through git:

   python3 -m pip install -e git://github.com/openml/openml-python.git@loose_initialization#egg=openml
   python3 -m pip install -U numpy
   

   I can't tell why you are unable to reinstantiate a 0.22.2.post1 run eventhough you have it installed. That requires some additional looking into (which unfortunately I don't have the time for right now, so I hope the branch with non-strict initialization is sufficient for now).
4. arpasan commented on Nov 19, 2020

   

   arpasan

   on Nov 19, 2020

   Author

   More actions

   Excellent, thanks @PGijsbers. I get a different error now, which I think is a progress though:
   

   Installing from the repo seems to work though so I'm not sure why it can't locate the openml package?
   
5. PGijsbers commented on Nov 19, 2020

   

   PGijsbers

   on Nov 19, 2020

   Collaborator

   More actions

   It looks like you are running from a notebook. I think the most likely scenario is that you are not using the environment that you installed openml in. Check e.g. import sys; sys.executable to make sure it is pointing to the right executable. If that looks correct, also try to see if you can import openml when running Python directly (from the command line). If you can import it, and the jupyter notebook is executed from the same environment, something else is off. I can't give more specific instructions since I don't know your setup, but I hope it helps. And of course a reboot (of the machine or the jupyter server) is always a good last resort 👍 sometimes things just get out of sync
6. arpasan commented on Nov 20, 2020

   

   arpasan

   on Nov 20, 2020

   Author

   More actions

   Terrific, thanks @PGijsbers. You're right. Turns out openml installs in another directory as you said. When I check for where by ! python3 -m site and change the instantiation to my directory sys.path.insert(1, 'my_path'), I'm able to import openml but then I'm back at the original dependency error which pops up again. Which is curious. Should that not have been fixed by installing from the loose_initialization branch? Thanks, and sorry for all the questions.
7. PGijsbers commented on Nov 20, 2020

   

   PGijsbers

   on Nov 20, 2020

   Last edited by PGijsbers

   Collaborator

   More actions

   Ah, I am so terribly sorry. I forgot to update the example code snippet. I am not on my dev pc right now, but I believe it should be:

   import openml
   tree = openml.runs.initialize_model_from_run(10417577, strict_version=False)

   Notice the strict_version argument, the default is True which means old behavior is maintained unless specified otherwise.
8. arpasan commented on Nov 20, 2020

   

   arpasan

   on Nov 20, 2020

   Author

   More actions

   Stupendous, passing the strict_version argument into the function does the trick! Thanks very much, this has been very helpful. Much obliged.

   👍React with 👍1Reacted by Pieter Gijsbers
9. mfeurer

   added

   module:FlowOpenML conceptOpenML concept

   on Feb 20, 2023
10. SubhadityaMukherjee

    closed this as completedon Jun 17, 2025