Data exchange between my armorers
I have a Flask application that serves up Nginx and Gunicorn with 3 workers. The My Flask app is an API microservice for working with NLP stuff, and I use the spaCy library for that.
My problem is that they take a huge amount of RAM as the spy pipeline loading is spacy.load('en')
very memory intensive and since I have 3 machine gunners each will take about 400MB of RAM.
My question is, is there a way to load the conveyor belt once and share it with all my gunsmith workers?
+5
source to share