Capriatto/normalise.py

Forked from j4mie/normalise.py

Created April 1, 2016 23:37

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/Capriatto/58f8cd23b664d547a47510da50b3738f.js"></script>
Save Capriatto/58f8cd23b664d547a47510da50b3738f to your computer and use it in GitHub Desktop.

Download ZIP

Revisions

j4mie created this gist Aug 30, 2010.

normalise.py

-Original file line number
+Diff line change
@@ -0,0 +1,11 @@
+    # -*- coding: utf-8 -*-
+    import unicodedata
+    """ Normalise (normalize) unicode data in Python to remove umlauts, accents etc. """
+    data = u'naïve café'
+    normal = unicodedata.normalize('NFKD', data).encode('ASCII', 'ignore')
+    print normal
+    # prints "naive cafe"