Python

Python: multiprocessing forking.py assertionError

Categories: Development Notes • Python; Tagged with: Lettuce • Nosetest • Python; @ March 22nd, 2016 23:32

Issue: There’s an AssertionError when I try to test mutliprocessing features using lettuce 0.2.22 / nosetests and python 2.7.10 error details:

multiprocessing\forking.py AssertionError: main
File "", line 1, in 
File "C:\Python27\Lib\multiprocessing\forking.py", line 380, in main
  prepare(preparation_data)
  File "C:\Python27\Lib\multiprocessing\forking.py", line 488, in prepare
    assert main_name not in sys.modules, main_name
AssertionError: __main__

upgrade to python 2.7.11 becuase this is a fixed bug: https://bugs.python.org/issue10128; or
use a wrapper (.py file name should be not in sys.modules, main_name):

# run_at.py:
__requires__ = 'lettuce==0.2.20'
import sys
from pkg_resources import load_entry_point

if __name__ == '__main__':
    sys.exit(
        load_entry_point('lettuce==0.2.20', 'console_scripts', 'lettuce')()
    )

Command Line Tool to Backup Local Files to Dropbox

Categories: Python; Tagged with: pip • Python; @ February 21st, 2016 16:32

main features

upload local file to dropbox
verify remote file after upload job completed
clear local / remote backup files to save space

how to use it

http://guoliang-dev.github.io/rabbit-backup/

how it works

rabbit-backup uses dropbox api to upload local file to dropbox.com; // that’s why we need a dropbox access token.

Youtube Command Line Tool: download all videos by user / playlist 批量下载Youtube视频

Categories: Python; Tagged with: pip • Python • youtube; @ February 21st, 2016 13:50

Features:

download all videos by user id 下载指定用户的所有视频
download all videos by playlist id 下载指定播放列表的所有视频
skip the previously downloaded files 跳过已下载视频

Usage:

pip install rabbit–youtube
set google api key

ready to use:

rabbit-youtube.py -u ChromeDevelopers /tmp/test/

for more details: http://guoliang-dev.github.io/rabbit-youtube/

Python: start and connect to a sftp server using paramiko

Categories: Python; Tagged with: Python • sftp; @ February 20th, 2016 22:24

requirement:

start a sftp server using python
connect to the sftp server and list files

code:

Docker python hello world project

Categories: Linux • Python; Tagged with: docker • Python; @ January 26th, 2016 23:12

create a Dockerfile
this image will install python and start a SimpleHTTPServer:

FROM ubuntu
ENV DEBIAN_FRONTEND noninteractive
CMD ["bash"]

RUN apt-get update
RUN apt-get install -y python

EXPOSE 8000
CMD python -m SimpleHTTPServer 8000

Build project
docker build -t myapp:latest .
run docker image
docker run -P myapp
-P for port forwarding: Publish all exposed ports to random ports
check the web page
find port by:
docker ps -l

This project can be found here:
https://github.com/guoliang-dev/docker-hello-world-python

Older Posts