Programming Laboratory-I Third Year Computer Engineering

Group-B Assignment No. 15

R N Oral Total Dated Sign

(2) (5) (3) (10)

Title of Assignment: aggregation and indexing using MongoDB.

Problem Definition:
Aggregation and indexing with suitable example using MongoDB
1.1 Prerequisite
Basic Commands of MongoDB
1.2 Learning Objective:
To learn indexing and aggregation using MongoDB
1.2 Theory:
1.2.1 INDEXING
Indexes support the efficient resolution of queries. Without indexes, MongoDB must scan
every document of a collection to select those documents that match the query statement.
This scan is highly inefficient and requires the mongod to process a large volume of data.
“Indexes are special data structures that store a small portion of the data set in an easy to
traverse form.”
The index stores the value of a specific field or set of fields, ordered by the value of the field
as specified in index.
The ensureIndex() Method
To create an index you need to use ensureIndex() method of mongodb.
SYNTAX:
Basic syntax of ensureIndex() method is as follows()

>db.COLLECTION_NAME.ensureIndex({KEY:1})

Here key is the name of filed on which you want to create index and 1 is for ascending
order. To create index in descending order you need to use -1.

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

EXAMPLE

>db.mycol.ensureIndex({"title":1})
>

In ensureIndex() method you can pass multiple fields, to create index on multiple fields.

>db.mycol.ensureIndex({"title":1,"description":-1})
>

ensureIndex() method also accepts list of options (which are optional), whose list is given
below:

Parameter Type Description

Builds the index in the background so that building an index

background Boolean does not block other database activities. Specify true to build
in the background. The default value is false.

Creates a unique index so that the collection will not accept

insertion of documents where the index key or keys match
unique Boolean
an existing value in the index. Specify true to create a unique
index. The default value is false.

The name of the index. If unspecified, MongoDB generates an

name string index name by concatenating the names of the indexed fields
and the sort order.

Creates a unique index on a field that may have duplicates.

MongoDB indexes only the first occurrence of a key and
dropDups Boolean removes all documents from the collection that contain
subsequent occurrences of that key. Specify true to create
unique index. The default value is false.

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

If true, the index only references documents with the

specified field. These indexes use less space but behave
sparse Boolean
differently in some situations (particularly sorts). The
default value is false.

Specifies a value, in seconds, as a TTL to control how long

expireAfterSeconds integer
MongoDB retains documents in this collection.

The index version number. The default index version

v index version depends on the version of mongod running when creating
the index.

The weight is a number ranging from 1 to 99,999 and

weights document denotes the significance of the field relative to the other
indexed fields in terms of the score.

For a text index, the language that determines the list of stop
default_language string words and the rules for the stemmer and tokenizer. The
default value isenglish.

For a text index, specify the name of the field in the

language_override string document that contains, the language to override the default
language. The default value is language.

1.2.2 AGGREGATION
Aggregations operations process data records and return computed results. Aggregation
operations group values from multiple documents together, and can perform a variety of
operations on the grouped data to return a single result. In sql count(*) and with group by
is an equivalent of MongoDB aggregation.

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

The aggregate() Method

For the aggregation in mongodb you should use aggregate() method.
SYNTAX:
Basic syntax of aggregate() method is as follows

>db.COLLECTION_NAME.aggregate(AGGREGATE_OPERATION)

EXAMPLE:
In the collection you have the following data:

{
_id: ObjectId(7df78ad8902c)
title: 'MongoDB Overview',
description: 'MongoDB is no sql database',
by_user: 'tutorials point',
url: 'http://www.tutorialspoint.com',
tags: ['mongodb', 'database', 'NoSQL'],
likes: 100
},
{
_id: ObjectId(7df78ad8902d)
title: 'NoSQL Overview',
description: 'No sql database is very fast',
by_user: 'tutorials point',
url: 'http://www.tutorialspoint.com',
tags: ['mongodb', 'database', 'NoSQL'],
likes: 10
},
{
_id: ObjectId(7df78ad8902e)

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

title: 'Neo4j Overview',

description: 'Neo4j is no sql database',
by_user: 'Neo4j',
url: 'http://www.neo4j.com',
tags: ['neo4j', 'database', 'NoSQL'],
likes: 750
},

Now from the above collection if you want to display a list that how many tutorials are
written by each user then you will use aggregate() method as shown below:

> db.mycol.aggregate([{$group : {_id : "$by_user", num_tutorial : {$sum : 1}}}])

{
"result" : [
{
"_id" : "tutorials point",
"num_tutorial" : 2
},
{
"_id" : "tutorials point",
"num_tutorial" : 1
}
],
"ok" : 1
}
>

SQL equivalent query for the above use case will be select by_user, count(*) from mycol
group by by_user

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

In the above example we have grouped documents by field by_user and on each occurance
of by_user previous value of sum is incremented. There is a list available aggregation
expression.

Expression Description Example

db.mycol.aggregate([{$group : {_id :
Sums up the defined value from all
$sum "$by_user", num_tutorial : {$sum :
documents in the collection.
"$likes"}}}])

Calculates the average of all given db.mycol.aggregate([{$group : {_id :

$avg values from all documents in the "$by_user", num_tutorial : {$avg :
collection. "$likes"}}}])

Gets the minimum of the db.mycol.aggregate([{$group : {_id :

$min corresponding values from all "$by_user", num_tutorial : {$min :
documents in the collection. "$likes"}}}])

Gets the maximum of the db.mycol.aggregate([{$group : {_id :

$max corresponding values from all "$by_user", num_tutorial : {$max :
documents in the collection. "$likes"}}}])

Inserts the value to an array in the db.mycol.aggregate([{$group : {_id :

$push
resulting document. "$by_user", url : {$push: "$url"}}}])

Inserts the value to an array in the

db.mycol.aggregate([{$group : {_id :
$addToSet resulting document but does not
"$by_user", url : {$addToSet : "$url"}}}])
create duplicates.

Gets the first document from the

db.mycol.aggregate([{$group : {_id :
$first source documents according to
"$by_user", first_url : {$first : "$url"}}}])
the grouping. Typically this makes

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

only sense together with some

previously applied “$sort”-stage.

Gets the last document from the

source documents according to
db.mycol.aggregate([{$group : {_id :
$last the grouping. Typically this makes
"$by_user", last_url : {$last : "$url"}}}])
only sense together with some
previously applied “$sort”-stage.

1.2.3 Pipeline Concept

In UNIX command shell pipeline means the possibility to execute an operation on some
input and use the output as the input for the next command and so on. MongoDB also
support same concept in aggregation framework. There is a set of possible stages and each
of those is taken a set of documents as an input and is producing a resulting set of
documents (or the final resulting JSON document at the end of the pipeline). This can then
in turn again be used for the next stage an so on.
Possible stages in aggregation framework are following:
 $project: Used to select some specific fields from a collection.
 $match: This is a filtering operation and thus this can reduce the amount of
documents that are given as input to the next stage.
 $group: This does the actual aggregation as discussed above.
 $sort: Sorts the documents.
 $skip: With this it is possible to skip forward in the list of documents for a given
amount of documents.
 $limit: This limits the amount of documents to look at by the given number starting
from the current position.s
 $unwind: This is used to unwind document that are using arrays. when using an
array the data is kind of pre-joinded and this operation will be undone with this to

SNJB’s Late Sau.KB Jain CoE ,Chandwad

Programming Laboratory-I Third Year Computer Engineering

have individual documents again. Thus with this stage we will increase the amount
of documents for the next stage.
Assignment Question:
1. Explain Types of Index in MongoDB
2. Explain Pipeline Concept in Mogo DB

SNJB’s Late Sau.KB Jain CoE ,Chandwad