Azure Automated ML Batch Endpoint Spacy 3.7.4 compatibility issue

 If you tried to create a Batch Endpoint on Azure ML Studio and receive an error like the one shown below, the solution is provided in this blog post. If you need any assistance, feel free to reach out to blog@aileronconsulting.com.

=========================================================

#10 401.7 The conflict is caused by:
#10 401.7     The user requested spacy==3.7.4
#10 401.7     en-core-web-sm 3.4.1 depends on spacy<3.5.0 and >=3.4.0
#10 401.7 
#10 401.7 To fix this you could try to:
#10 401.7 1. loosen the range of package versions you've specified
#10 401.7 2. remove package versions to allow pip attempt to solve the dependency conflict
#10 401.7 
#10 401.7 
#10 401.7 failed
#10 401.7 
#10 401.7 CondaEnvException: Pip failed

=========================================================

The issue is in the environment file and the package en_core_web_sm-3.4.1 is not compatible with spacy 3.7.4.

Reach out (blog@aileronconsulting.com) if you would like to create custom environment that uses en_core_web_sm-3.7.1, which is compatible with the spacy package and use this base image  https://mcr.microsoft.com/azureml/curated/ai-ml-automl-dnn-gpu:21.