https://hieuphay.com/tags/python/Recent content in Python on Hieu PhayHugoenNguyen Duc HieuNguyen Duc HieuFri, 30 Oct 2020 00:00:00 +0000https://hieuphay.com/blog/2020-10-30_google-translation/Fri, 30 Oct 2020 00:00:00 +0000https://hieuphay.com/blog/2020-10-30_google-translation/<p>Slightly related to my <a href="https://hieuphay.com/blog/2020-10-01_python-polyglot-detect-and-tokenize/">previous post</a>, one of my tasks today was to translate a list of keywords into different languages. The inputs I received generally looks something like below. There were many more, but I truncated the bulk of it to provide a simpler example:</p> <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-text" data-lang="text"><span class="line"><span class="cl">- Institutions: disputes, grievance, court, penal, judicial, prosecutorial, punishment, lawyer, attorney </span></span><span class="line"><span class="cl">- Infrastructure: railways, traffic, trucks, cars, vehicles, road, taxi, public transportation, port, logistics, collision, passenger </span></span><span class="line"><span class="cl">[...] </span></span></code></pre></div><h2 id="reshape-the-text-into-a-processible-format"> Reshape the text into a processible format <a class="heading-link" href="#reshape-the-text-into-a-processible-format" aria-labelledby="reshape-the-text-into-a-processible-format"> <i class="fa fa-link" aria-hidden="true"></i> </a> </h2> <p>Firstly, I need to transform these texts into a better format. A good text editor certainly helps. I was able to quickly convert these texts into <code>csv</code> format, using Emacs&rsquo; macro functionality and Vi&rsquo;s keybindings.</p>https://hieuphay.com/blog/2020-10-01_python-polyglot-detect-and-tokenize/Thu, 01 Oct 2020 00:00:00 +0000https://hieuphay.com/blog/2020-10-01_python-polyglot-detect-and-tokenize/<p>My upcoming works involves some text analysis so I&rsquo;m exploring some of the available tools in Python. Today I tested some of the basic operations with the <code>polyglot</code> package.</p> <h2 id="installation"> Installation <a class="heading-link" href="#installation" aria-labelledby="installation"> <i class="fa fa-link" aria-hidden="true"></i> </a> </h2> <p>Following the <a href="https://polyglot.readthedocs.io/en/latest/Installation.html">installation instructions</a>, I install the dependencies for <code>polyglot</code> on my Ubuntu 20.04 machine with:</p> <div class="highlight"><pre tabindex="0" class="chroma"><code class="language-shell" data-lang="shell"><span class="line"><span class="cl">sudo apt-get install python-numpy libicu-dev </span></span></code></pre></div><p>But I still got an <code>ModuleNotFoundError</code> for <code>icu</code> when I try to import <code>polyglot</code> in, so I fixed this by installing the module with <code>pip</code>:</p>