#mongodb

Docker, Linux

How to HOT Backup Database (MongoDB, MySQL, ES …) to AWS S3

0

Actually, there are many way to backup your database. You can using RSYNC, MongoDump for Mongo, S3 Backup Plugin for ElasticSearch. However, this post will show you the way I used in my project. Maybe, It is not perfect for all case. But in my case, it is really perfect.

Docker Ironman T-shirt

Docker Ironman T-shirt

I am running a project with Microservice Architecture. All Databases and Services are running in Docker Container.  In my plan, I have to backup all databases every night.

At the beginning, I tried to use tar command to compress the data, and then I use command aws s3 copy to copy backup data to S3. It seems work. But tar command makes MongoDB stop working. I tried to google to solve the problem. I found the solution is rsync command.

The backup process should be implement in three steps:

  • Use rsync command to copy the data to other location
  • Compress the data by tar command
  • Move the compressed data to AWS S3

The script should be:

1
2
3
4
echo Backup MongoDb Data ...
rsync -avz /var/lib/docker/volumes/backend_mongodb/ /tmp/mongodb && \
    tar cvzf mongodb-${dt}.tar.gz /tmp/mongodb/ && \
    aws s3 cp mongodb-${dt}.tar.gz s3://prjbackups/${env}/mongodb/mongodb-${dt}.tar.gz

Thanks for your reading.

Nguyen Sy Thanh Son

0

Linux, PHP

Install MongoDB and Mongo PHP in Ubuntu

5

I am using Ubuntu Server 14.04 OS for my working enviroment. All steps below is way I implemented successfully on my machine. So now, I will show you how to install MongoDB and Mongo PHP driver.

530df3ee-2908-11e4-beda-12313d275d6d-medium

Firstly, install MongoDB. You can see it is so simple and one and only one command.

1
sudo apt-get install mongodb

To make sure that MongDB is running, you can use command below

1
2
3
thanhson1085@sonnst:~/projects$ ps -ef|grep mongo
245:mongodb   2870     1  4 11:52 ?        00:00:21 /usr/bin/mongod --config /etc/mongodb.conf
248:thanhso+  2905  1615  0 12:00 pts/0    00:00:00 grep --color=auto mongo

To install Mongo PHP Driver, you use the command below.

1
sudo pecl install mongo

The command above use Pecl, so if you machine have not installed it yet. You can install easily by the command below

1
sudo apt-get install php5-dev php5-cli php-pear

And now, you have to enable Mongo PHP extension by way add “extension=mongo.so” to php.ini file or use the commands below

1
2
3
4
sudo -s
echo "extension=mongo.so" > /etc/php5/mods-available/mongo.ini
php5enmod mongo
exit

Almost done, just need to check that your job is done or not.

1
2
3
4
5
6
7
8
9
10
11
thanhson1085@sonnst:~$ php -i|grep mongo
16:/etc/php5/cli/conf.d/20-mongo.ini,
330:mongo
343:mongo.allow_empty_keys => 0 => 0
344:mongo.chunk_size => 261120 => 261120
345:mongo.cmd => $ => $
346:mongo.default_host => localhost => localhost
347:mongo.default_port => 27017 => 27017
348:mongo.is_master_interval => 15 => 15
349:mongo.long_as_object => 0 => 0
350:mongo.native_long => 1 => 1

And writing a php script to create document, collection and insert data to mongodb.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
<?php
 
// connect
$m = new MongoClient();
 
// select a database
$db = $m->test1;
 
// select a collection (analogous to a relational database's table)
$collection = $db->colection_test;
 
// add a record
$document = array( "title" => "New One", "author" => "Nguyen Sy Thanh Son" );
$collection->insert($document);
 
// add another record, with a different "shape"
$document = array( "title" => "The Second One", "online" => true );
$collection->insert($document);
 
// find everything in the collection
$cursor = $collection->find();
 
// iterate through the results
foreach ($cursor as $document) {
    echo $document["title"] . "\n";
}
 
?>

If success, the output will be same as the below

1
2
3
$ sudo php test.php
New One
The Second One

 

Nguyen Sy Thanh Son

5