Packaging Python Dependencies for PySpark Using conda-pack

Posted on Apr 30, 2021 in Computer Science • Tagged with programming, PySpark, Python, conda, conda-pack, dependency, Spark, big data, portable

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

python-build-standalone is a better alternative to conda-pack on managing Python dependencies for PySpark. Please refer to Packaging Python Dependencies for PySpark Using python-build-standalone for tutorials on how …


Continue reading

Tips on conda-pack

Posted on Apr 30, 2021 in Computer Science • Tagged with programming, conda-pack, conda, dependency, virtual environment

It is suggested that you use python-build-standlone instead of conda-pack to build portable Python environments. Please refer to Packaging Python Dependencies for PySpark Using Python-Build-Standalone for more details.

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better …


Continue reading