Tag Archives: zato

Upgrading requests_toolbelt in Zato 2.0.8

December 5, 2019 Andrew Bennett Leave a comment

After failing with pip and easy_install I came across this post again:

https://forum.zato.io/t/what-is-the-canonical-way-to-add-extra-python-packages-to-my-zato-server/580?source_topic_id=586

There is another way, that of updating versions.cfg and buildout.cfg files but if you are more familiar with pip than buildout then pip install package-name is perfectly fine.

So it turns out it is as easy as:

nano ~/current/versions.cfg
update the version from 0.2.0 to 0.8.0 then run
cd ~/current
buildout

And buildout will do it’s magic.

Notepad

Zato: Add MSSQL to Outgoing SQL Options

February 25, 2019 Andrew Bennett Leave a comment

To Connect with MSSQL or SQL Server via Zato 3:
#sudo su - zato $/opt/zato/current/bin/pip install pymssql (More info: http://pymssql.org/en/stable/intro.html) $nano /opt/zato/env/qs-1/server1/config/repo/sql.conf

Add the following lines at the end:
[mssql+pymssql] display_name=MSSQL sqlalchemy_driver=mssql+pymssql ping_query=SELECT 1

???I don’t know if this is required or not, but I still do it.
Deploy to other servers in the cluster:
$cp /opt/zato/env/qs-1/server1/config/repo/sql.conf /opt/zato/env/qs-1/server2/config/repo/

Restart your cluster and MSSQL should appear as an option under SQL Outgoing connections.

Clippings

Zato MySQL Connection with UTF-8

January 10, 2018 Andrew Bennett Leave a comment

Today this error appeared in an Zato Service:

UnicodeEncodeError: 'latin-1' codec can't encode character u'\u2019' in position 1: ordinal not in range(256)

I turns out that SQLAlchemy defaults to latin-1 encoding instead of UTF-8 for MySQL connections.

Thanks to Andrea on a Zato Thread here: https://mailman-mail5.webfaction.com/pipermail/zato-discuss/2015-November/001443.html points out that we can just add
dbname?charset=utf8 in the WebUI.

While not intuitive, it does work.
I added it, had the service try the action again and all was well in the world again.

Clippings

Zato and Pandas (strange combination I know)

June 13, 2017 Andrew Bennett Leave a comment

I’ve been working with Zato for a project and I’m getting some random text out of a HTTP request that looks like a CSV file, so the easiest way I know how to deal with this CSV data is with Pandas, then I could process it enough and clean it up to hand back to Zato.

But Zato doesn’t ship with Pandas….
(TL;DR at the bottom of the post)

In theory this should work:
/opt/zato/2.0.7/bin/pip install pandas

But then I get the error when I do the following:
/opt/zato/2.0.7/bin/python >>> import pandas as pd File "/opt/zato/current/local/lib/python2.7/site-packages/pandas/__init__.py", line 19, in "Missing required dependencies {0}".format(missing_dependencies)) ImportError: Missing required dependencies ['pytz', 'dateutil']

No luck.

After trying pip install pytz and pip install –upgrade pytz
I get this error:
Installing collected packages: pytz Found existing installation: pytz 2014.4 Cannot remove entries from nonexistent file /opt/zato/2.0.7/eggs/easy-install.pth

But this does work:
/opt/zato/2.0.7/bin/easy_install --upgrade pytz

Now to fix dateutil.
easy_install --upgrade python-dateutil

Let’s try it again:
/opt/zato/2.0.7/bin/python >>> import pandas as pd Traceback (most recent call last): File "", line 1, in File "/opt/zato/current/local/lib/python2.7/site-packages/pandas/__init__.py", line 23, in from pandas.compat.numpy import * File "/opt/zato/current/local/lib/python2.7/site-packages/pandas/compat/__init__.py", line 361, in from dateutil import parser as _date_parser File "/opt/zato/current/local/lib/python2.7/site-packages/python_dateutil-2.6.0-py2.7.egg/dateutil/parser.py", line 40, in from six import text_type, binary_type, integer_types ImportError: No module named six

Bummer!

easy_install six

And for a final test:
/opt/zato/2.0.7/bin/python >>> import pandas as pd >>>

Yay, it’s working. Hopefully, nothing in Zato has broken…

TL;DR:

/opt/zato/2.0.7/bin/easy_install pandas /opt/zato/2.0.7/bin/easy_install --upgrade pytz /opt/zato/2.0.7/bin/easy_install --upgrade pytz /opt/zato/2.0.7/bin/easy_install six

UPDATE:
(I have not tested this)
It might work better to use buildout to make this work see this comment here:

https://forum.zato.io/t/what-is-the-canonical-way-to-add-extra-python-packages-to-my-zato-server/580?source_topic_id=586

There is another way, that of updating versions.cfg and buildout.cfg files but if you are more familiar with pip than buildout then pip install package-name is perfectly fine.

However, if a dependency is not on PyPI nor any other package index (such as your own internal one) then you can place individual Python modules in zato_extra_paths too.

Andrew Bennett Blog