#Linux

Fix UTF-8 Issue with Python Logger

When you work with Python Logger to STDOUT, sometimes you got error messages as the below:

The reason is STDOUT does not support UTF-8 encoder.

I try to google to solve the issue. And I got the solution. We have to create environment variable PYTHONIOENCODING=utf-8

So It works.

Compress/Split/Concat MP4 with AVCONV

This post just save some command that I used to edit my video. Hope it is helpful with you.

Compress MP4 with H264:

Split Video by time frame:

Concat/Join two video files:

Export video to PNG files

Create GIF from PNG files (ImageMagick):

 

 

I start studying Internet of Things

As you know, Internet Of Things is the hottest technical trend in the world recently. So we should study it. A old developers should learn it before becoming a backward guys. And a young developer should learn IOT to make the future better that today, or just simple to have  a good job.

I heard about IOT the last year.  From there,  I thought about it when i have free time. I prepared basic knowledge about IOT as below:

  • The Essentials of Electricity & Electronics
  • IOT Concept
  • IOT Architecture Overview
  • MQTT Protocol

I am a Software Developer, I always want to start writing source code after leaning a bit theory. But I do not know how to start.  So I joined Maker Hanoi ( A IOT Group in Hanoi Vietnam) and started study a IOT class for beginners there.

At the beginning, I bought a NodeMCU ESP8266 Dev Kit with price 9$ (200.000 VND)

NodeMCU ESP8266 Dev Kit

NodeMCU ESP8266 Dev Kit

I also need a micro USB cable to connect Development Kit to my computer.

Micro USB Cable

Micro USB Cable

After having DevKit, I took a look to ESP8266 Datasheet to understand ESP8266’s pins, functions. I also need to refer the image below to know Port Mapping between DevKit and ESP8266.

NodeMCU ESP8266 Dev Kit Pin Out

NodeMCU ESP8266 Dev Kit Pin Out

After the hardware was under my control, I went to the next step – studying software. I was suggested using Sming Framework to write firmware for ESP8266.  Sming Framework is easy to understand and use. However,  maybe you can have some issues with installation.

My first idea about IOT is pushing data from ESP8266 to an IOT Cloud Platform.  Actually, there are many solutions for IOT Platform. For example, I can build a IOT Platform on my own by using open source, or try IBM IOT Platform. However,  to simple and free, I chose Koor.IO – An IOT Platform for Developer.

With Koor.IO, I can have use Restful API, Websocket and MQTT. Koor.IO help me collect data and show on chart.

To implement my idea with Koor.IO, I just do the some steps below:

Step 1: Create Project

Create an account on Koor.IO and create my first project.

Create a IOT Project on Koor.IO

Create a IOT Project on Koor.IO

Waiting until Koor.IO finishing setup your project

2016-10-12_1700

After that, open your project, create Field to indicate what field you need KoorIO collect the data.

2016-10-12_1704

Now, you are done with Koor.IO

Step 2: Source code

In this step, you clone Koor.IO’s MQTTClient example.

You need to change configuration file include/config.h

MQTT_TOPIC should be project_domain/field. And field  is the field you created on koor.io, project_domain is the domain of your Koor.IO Project.

MQTT_HOST, you enter mqtt.koor.io

And I entered your Wifi Information in WIFI_SSID, WIFI_PWD

Step 4: Build

After change the configuration file, We just need to build the source code and load into ESP6266 by the commands:

Result

After build flash was successful, I go to the dashboard of the project on Koor.IO to see the data was pushed from the device. The chart is updated realtime as below.

Koor.IO - Chart - ESP8266

Koor.IO – Chart – ESP8266

Troubleshoot

With Linux,  in case you can not load data to ESP8266, you should check the connection between DevKit and your computer by command

Or

If you did not see the logs from ESP8266. You can use screen command:

Thank you for your reading!!!

 

MQTT, HTTP Haproxy Configuration

If you are building a system that serves both HTTP and MQTT, I sure that you have to use HAProxy. So in this post, I will share you the way to setup HAProxy to serve Nginx and MQTT Broker.

Your haproxy.cfg file should contain the source code below:

Haproxy MQTT Configuration

Note: broker is MQTT Broker’s hostname

Haproxy Nginx

For monitoring Haproxy, You can add Haproxy Stats Configuration

Final Result haproxy.cfg

 

 

Using Ngrok to publish HTTP and SSH for your Rasperberry Pi

I have a Rasperberry Pi 2, and i put it in my home in the silent.  Sometimes I need to ssh to my Pi or view a website that I deployed to my Pi. I looked for a solution in the Internet. I found Ngrok. I really fitted my case. So in this post, I will share you the way to setup Ngrok on Rasperberry Pi in step by step.

12355f58-3a8b-4ed9-a507-8800b2080041-original

Download Ngrok

You find the correct link to download at https://ngrok.com/download. You see “Linux ARM” and get the link.

After that, you do some commands to download and decompress:

Creating Configuration File for Ngrok

We need to publish two tunnels (ssh, http). So we have to create a Ngrok configuration file to declare those services.

I create a file named ngrok.yml with content as below

web_addr: 0.0.0.0:4040 means that I can access Ngrok Webpage on my Pi via http://RASPERBERRY_PI_IP_ADDRESS:4040

I also declare two protocols and address for two tunnels – SSH and HTTP

Installing Supervisor

We need run Ngrok as a daemon (in background). So I use Supervisor – a third-party process manager. You can install Supervisor with command.

After finishing the installation, we create a Supervisor configuration file at /etc/supervisor/config.d/ngrok.conf with content as below

Running the tunnels

In this step, we just need to run the program via Supervisor by command:

Verifying your works

Now, we open the browser and access http://PI_IP_ADDRESS:4040 to get the information of tunnels and try a test.

Vagrant – Failed to mount folders in Linux guest

I usually use Vagrant in Development Environment.  I need Vagrant to create Ubuntu Server on Windows 10 Desktop. Everthing work fine until one day, I met an error “Failed to mount folders in Linux guest”.

So I fixed it by command below:

Education is the most powerful weapon which you can use to change the world

Education is the most powerful weapon which you can use to change the world

If you meet an error as below

You have to change Vagrant Home Directory to a path without spaces.

 

Install Docker and Docker Swarm on CentOS7

This tutorial will show you how to install Docker and Docker Swarm on CentOS7. This tutorial is for Docker Version 1.11 and I use Vagrant and VirtualBox to create CentOS 7 in Virtual Machine.

Stop worrying about what you have to loose and start focusing on what you have to gain

Stop worrying about what you have to loose and start focusing on what you have to gain

Create a Vagrantfile for CentOS7

Turn on your Virtual Machine with command:

After finishing creating CentOS server, you access the server via SSH by command:

Docker

Go to root account:

In the next step, we will install Docker Engine following the official tutorial of Docker.

Add Docker Repository  into CentOS

Running the installation

Start Docker Service

Enable Docker run on OS Start

Docker Swarm

Installing Docker Swarm via Docker Pull

Open Docker Service Configuration file

In the line contains ExecStart, we add text as below

And now, reload Docker Service

Now we can run Swarm Node

And running Swarm Manage

Finally, verify your work

Video

Thanks for your reading!!!

Delete a commit from branch in Git

I sure that there is at least once time in the life of a programmer, they need to delete a commit in the history of a branch. So I write this post to share you the way to delete a commit from branch in Git.

My example is we have a git log tree as below:

And you are working on branh DEV, you need to remote “Commit C” from branch DEV. So you should use command git rebase -i

In there, “ea61baa” is the hash key of “Commit C”. After entering the command, a editor will be opened with the content below:

You have to remove line

After that, save it.

You are done, just re-check by git log command

You can see that “Commit C” now is not in branch dev.

OpenSSL generates keys

Sometimes, you have to generate the keys for your projects. You can use the coomand below:

Create a Private CA

Public CA

Sign Keys

CSR

Certs