Packaging Python Dependencies for PySpark Using conda-pack

Posted on Apr 30, 2021 in Computer Science • Tagged with programming, PySpark, Python, conda, conda-pack, dependency, Spark, big data, portable

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

python-build-standalone is a better alternative to conda-pack on managing Python dependencies for PySpark. Please refer to Packaging Python Dependencies for PySpark Using python-build-standalone for tutorials on how …


Continue reading

Conda Build Issue

Posted on Jul 23, 2018 in Computer Science • Tagged with programming, Anaconda, Python, conda build, sqlalchemy-teradata, conda

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

I encountered an issue building the package sqlalchemy-teradata. There are a few related issues: issues/2790, issues/2826. It seems that the recipe uses an outdated URL …


Continue reading

Tips on Spyder

Posted on May 22, 2015 in Software • Tagged with software, SpyDer, Python, IDE

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

** Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives. **

http://www.southampton.ac …


Continue reading

Work With Teradata SQL in Python

Posted on May 17, 2017 in Computer Science • Tagged with programming, Python, Teradata SQL, Teradata

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

** Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives. **

ODBC

teradata

  1. teradata relies …


Continue reading

Tips on PyBuilder

Posted on Jan 12, 2019 in Computer Science • Tagged with programming, PyBuilder, Python, project management

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

** Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives. **

Poetry is a better …


Continue reading

Install Python Pip in Cygwin

Posted on Mar 04, 2019 in Software • Tagged with software, Python, Cygwin, pip

python3 -m ensurepip

Things under legendu.net/outdated are outdated technologies that the author does not plan to update any more. Please look for better alternatives.

References

https://stackoverflow.com/questions/30863501/installing-new-versions-of-python-on-cygwin-does-not-install-pip