Useful Path Handling Functions in Python

Photo by Birgit Held from Pexels

Recently, I published an article about path handling functions in R which are built-in functions in base R.

Since I use both languages at my work — I work as a Bioinformatician (= a Data Scientist/Analyst working on biomedical datasets), I wanted to have the same list for Python.

Path handling functions in Python are not built-in into base Python. They are distributed across three standard packages: os, pathlib(for Python3; pathlib2 when using Python2), andshutil. Therefore, they are shipped with Python, so at least you don’t have to install them. Often, each of the packages offer solutions for different problems in path handling. None of the packages contains all necessary functions. Thus, the listing in Python looks heterogeneous and not so straight forward and smooth like in base R.

In this article, I give you my researched corresponding Python functions for each of the R commands given in the previous article “Useful Path Handling Functions in R” .

1. How to get/set the current directory in Python

Get the current working directory:

os.path.abspath(os.getcwd())  # abspath because to deal with Windows
os.path.realpath('.') # eliminates symbolic links
# and replace them by the real path
pathlib.Path(__file__).resolve() # resolve to absolute path

Set the current working directory:

os.chdir("/to/dir") # no corresponding in pathlib or shutil

2. How to dissect and access Path Name Components in Python

Dir name (parent directory’s name of the path):


Base name (file name of the path):


File extensions:

filename, file_extension = os.path.splitext(path)

3. How to join Path Components in Python

os.path.join("/dir", "dir", "file.txt")                                                
pathlib.Path("/dir") / "dir" / "file.txt"
pathlib.PurePath("/dir", "dir", "file.txt")
# make Path() objects to string using `str()`
# or their `.as_posix()` method
# they all create "/dir/dir/file.txt"

4. How to recursively list Files in Folders in Python

# recursivity through wildcards `**`!

5. How to test for Existence of Files and Folders in Python

# for both:
# for folders
# for files
# there is also

6. How to create new Folders and Files in R

pathlib.Path("/to/new/dir").mkdir(exist_ok=True, parents=True)
os.makedirs("/to/new/dir", exist_ok=True)
# create a file (touch)

7. How to (recursively) delete Files and Folders in Python

# for both
# rmdir (however, I never liked rmdir - it deletes only empty folders)
os.rmdir(dir_path, missing_ok=True)

8. How to copy Folders with contents and Files in R

# copy a folder recursively
shutil.copytree(src="/from/dir", dst="/to/dir",
# copy a file
"/to/file.txt", # must be a complete file
shutil.copy("/to/file.txt", "/new/dir/file.txt") # only Python3.8+ # # in <Python3.8 put `str()` around Path() objects! or `.as_posix()`!

9. How to move and rename Folders and Files in in Python

# move a folder recursively
shutil.move(src="/from/dir", dst="/new/dir", copy_function=shutil.copy2)
# Files:
os.rename("/to/file.txt", "/new/dir")
shutil.move("/to/file.txt", "/new/dir")

10. How to get the size and creation time of Folders and Files in Python

# and one can use the setters tooos.path.isdir(path)# look for methods in

In general, path handling in Python is much more hetereogenous and messy than in R. Perhaps, one should streamline Python path handling functions to be R-like in a new package. This should be the topic of the next publication.




Code tweaker + Human Geneticist (Ph.D.) | Join medium by:

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Test driven development

Lego: A Proportional LineFollower Robot

Calculator Program in Python

Configuring SSL for an Elastic Beanstalk Application

Installing Linux (CentOS 7) on an older Windows laptop

Best YouTube Channels to Learn Python

TCS NQT Coding Question 2020–2021

Update on Adadex Tools Project Development

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Gwang Jin Kim

Gwang Jin Kim

Code tweaker + Human Geneticist (Ph.D.) | Join medium by:

More from Medium

Python Sequences — Types, Operations, and Functions

Python Sequences — Types, Operations, and Functions

Python Fundamental — Beginer to Advance Part-4 Loops

Python for loop

What are user-defined functions in Python?