Table of Contents

MongoDB is a NoSQL database with great features like replication and sharding built in. This allows you to scale your database to as many servers as you would like by distributing content among them.

Before anything MongoDB related is installed, we need to ensure our hardware is correctly chosen and software is fine tuned.

1. Hard Drives

mongodb illustration for: 1. Hard Drives

If you have a choice of selecting which hard drives you will have, go with enterprise grade dual SSD drives in RAID1. As we have covered before, they are great on performance and actually save you money.

Edit your /etc/fstab file in Linux and make sure to disable access time logging on your mount that will be used with MongoDB. Add noatime in 4th column:

<img src="images/how-to-set-up-a-scalable-mongodb-database-section-1.png;

Re-mount the partition:

				
					[root@mongodb1 ~]# mount -o remount /

Verify that the new settings took effect:

				
					[root@mongodb1 ~]# mount
				
			
				
					/dev/sda on / type ext4 (rw,noatime)

2. CPU and Memory

Setting MongoDB as a VM on a hypervisor would let you scale up RAM and CPU cores later on. Amount of CPU cores and RAM that should be assigned depends on your infrastructure needs and budget.

3. Optimization

The most useful tip is to optimize your database queries:

  • Add indexes for commonly searched or sorted queries.
  • Use MongoDB’s explain() command.
  • Limit search results and limit fields that are being returned.

For testing purposes, we’ll spin up 3 droplets:

<img src="images/how-to-set-up-a-scalable-mongodb-database-section-1.png;

Installation

This procedure will be the same on mongodb1, mongodb2, and mongodb3. Installing MongoDB on CentOS is very simple. Add the following repository by editing

				
					/etc/yum.repos.d/10gen.repo
				
			
				
					[10gen]

name=10gen

baseurl=http://downloads-distro.mongodb.org/repo/redhat/os/x86_64

gpgcheck=0

enabled=1

Now install the packages:

				
					[root@mongodb1 ~]# yum -y install mongo-10gen mongo-10gen-server

Enable MongoDB to start on reboot, and start the service:

				
					[root@mongodb1 ~]# chkconfig mongod on &amp;&amp; service mongod start
				
			
				
					Starting mongod: forked process: 1387

all output going to: /var/log/mongo/mongod.log

child process started successfully, parent exiting

                                                           [  OK  ]

Now you should be able to see statistics on http://SERVER:28017/

Setting up Master-Slave replica set

We’ll assign mongodb1 as a master server. Add “master = true” to /etc/mongod.conf and do

				
					service mongod restart

<img src="images/how-to-set-up-a-scalable-mongodb-database-section-1.png;

While mongodb2 and mongodb3 will be setup as slaves. Add “slave=true”, “source = mongodb1” to /etc/mongod.conf and do

				
					service mongod restart

<img src ="images/how-to-set-up-a-scalable-mongodb-database-section-1.png;

Now we should secure this database with a password or add iptables rules to ports 27017 (MongoDB) and 28017 (Web interface).

To create a user with password:

				
					&gt; use test
				
			
				
					&gt; db.addUser('admin', 'password');

{

        "user" : "admin",

        "readOnly" : false,

        "pwd" : "90f500568434c37b61c8c1ce05fdf3ae",

        "_id" : ObjectId("50eaae88790af41ffffdcc58")

}

We should also add firewall rules to restrict to other MongoDB servers, our IP, and save:

				
					[root@mongodb1 ~]# iptables -N MongoDB

[root@mongodb1 ~]# iptables -I INPUT -s 0/0 -p tcp --dport 27017 -j MongoDB

[root@mongodb1 ~]# iptables -I INPUT -s 0/0 -p tcp --dport 28017 -j MongoDB

[root@mongodb1 ~]# iptables -I MongoDB -s 127.0.0.1 -j ACCEPT

[root@mongodb1 ~]# iptables -I MongoDB -s 192.34.57.64 -j ACCEPT

[root@mongodb1 ~]# iptables -I MongoDB -s 192.34.56.123 -j ACCEPT

[root@mongodb1 ~]# iptables -I MongoDB -s 192.34.57.162 -j ACCEPT

[root@mongodb1 ~]# iptables -A MongoDB -s 0/0 -j DROP

[root@mongodb1 ~]# /etc/init.d/iptables save
				
			
				
					iptables: Saving firewall rules to /etc/sysconfig/iptables:[  OK  ]

Repeat this procedure on your other MongoDB servers (mongodb2, mongodb3).

If you are using PHP for your frontend, you would need to install MongoDB module for PHP:

				
					[root@webserver ~]# pecl install mongo

[root@webserver ~]# echo extension=mongo.so &gt;&gt; `php -i | grep /php.ini | awk '{print $5}'`

[root@webserver ~]# service httpd restart

Populate your database with data

Now we can begin testing our new setup. You can access the database from command shell by typing mongo :

				
					[root@mongodb1 ~]# mongo
				
			
				
					MongoDB shell version: 2.2.2

connecting to: test

Lets enter New York Times Bestsellers list into the database for testing:

				
					&gt; db.books.save( { title: 'Safe Haven', author: 'Nicholas Sparks' } )

&gt; db.books.save( { title: 'Gone Girl', author: 'Gillian Flynn' } )

&gt; db.books.save( { title: 'The Coincidence Of Callie And Kayden', author: 'Jessica Sorensen' } )

&gt; db.books.save( { title: 'Fifty Shades of Grey', author: 'E.L. James' } )

&gt; db.books.save( { title: 'Hopeless', author: 'Colleen Hoover' } )

To display all results:

				
					&gt; db.books.find()

{ "_id" : ObjectId("50eaaa4b633625147f205994"), "title" : "Safe Haven", "author" : "Nicholas Sparks" }

{ "_id" : ObjectId("50eaaa62633625147f205995"), "title" : "Gone Girl", "author" : "Gillian Flynn" }

{ "_id" : ObjectId("50eaaa8d633625147f205996"), "title" : "The Coincidence Of Callie And Kayden", "author" : "Jessica Sorensen" }

{ "_id" : ObjectId("50eaaaa0633625147f205997"), "title" : "Fifty Shades of Grey", "author" : "E.L. James" }

{ "_id" : ObjectId("50eaaab3633625147f205998"), "title" : "Hopeless", "author" : "Colleen Hoover" }

You should be able to see the same entries on mongodb2 and mongodb3 since they are a replica sets:

<img src="images/how-to-set-up-a-scalable-mongodb-database-section-1.png;

<img src="www.progressiverobot.com/articles/scalable_mongodb/img6.png">

You could’ve entered all kinds of values for these books, such as publisher’s name, ISBN number, average customer rating, written language, and so on. In order to optimize your queries, however, it is best to limit number of results, and number of fields being returned.

For example, to return only 2 results we would use limit() at the end:

				
					&gt; db.books.find( {}, { title : 1 , author: 1 } ).sort( { timestamp : -1 } ).limit(2)

{ "_id" : ObjectId("50eaaa4b633625147f205994"), "title" : "Safe Haven", "author" : "Nicholas Sparks" }

{ "_id" : ObjectId("50eaaa62633625147f205995"), "title" : "Gone Girl", "author" : "Gillian Flynn" }

Once you have reached maximum capacity for your current setup, you can begin sharding your database. We will cover this in a future post.