Formal Languages, Automata and Computability: WWW - Cs.cmu - Edu/ Emc/flac09

15-453
FORMAL LANGUAGES,
AUTOMATA AND
COMPUTABILITY
www.cs.cmu.edu/~emc/flac09
INSTRUCTORS
Edmund Clarke
Will Klieber Yi Wu
Grading
Exams: 50%
- Final Exam: 25%
- Midterm Exam: 25%
Homework: 45%
Class Participation: 5%
Attendance is required.
HOMEWORK
Homework will be assigned every Thursday
and will be due one week later at the
beginning of class
You must list your collaborators and all

references in every homework assignment.
Readings will be posted on the course website.

For next class: Read Chapters 0 and 1.1
www.cs.cmu.edu/~emc/flac09
This class is about mathematical
models of computation
WHY SHOULD I CARE?
WAYS OF THINKING
THEORY CAN DRIVE PRACTICE

Mathematical models of computation
predated computers as we know them
THIS STUFF IS USEFUL

Course Outline
PART 1
Automata and Languages:
finite automata, regular languages, pushdown automata, context-free
languages, pumping lemmas.
PART 2
Computability Theory:
Turing Machines, decidability, reducibility, the arithmetic hierarchy, the
recursion theorem, the Post correspondence problem.
PART 3
Complexity Theory and Applications:
time complexity, classes P and NP, NP-completeness, space complexity
PSPACE, PSPACE-completeness, the polynomial hierarchy, randomized
complexity, classes RP and BPP.
Mathematical Models of Computation
(predated computers as we know them)
PART 1
Automata and Languages: (1940’s)
finite automata, regular languages, pushdown automata, context-free
languages, pumping lemmas.
PART 2
Computability Theory: (1930’s-40’s)
Turing Machines, decidability, reducibility, the arithmetic hierarchy, the
recursion theorem, the Post correspondence problem.
PART 3
Complexity Theory and Applications: (1960’s-70’s)
time complexity, classes P and NP, NP-completeness, space complexity
PPACE, PSPACE-completeness, the polynomial hierarchy, randomized
complexity, classes RP and BPP.
This class will emphasize PROOFS
A good proof should be:
Easy to understand
Correct
Suppose A  {1, 2, …, 2n} with |A| = n+1
TRUE or FALSE: There are always two

numbers in A such that one divides the
other
TRUE
LEVEL 1
HINT 1:
THE PIGEONHOLE PRINCIPLE
If you put 6 pigeons in 5 holes
then at least one hole will have
more than one pigeon
LEVEL 1
HINT 1:
LEVEL 1
HINT 1:
HINT 2:
Every integer a can be written as a = 2km,
where m is an odd number
LEVEL 2
PROOF IDEA:
Given: A  {1, 2, …, 2n} and |A| = n+1
Show: There is an integer m and elements

a1  a2 in A
such that a1 = 2im and a2 = 2jm
LEVEL 3
PROOF:
Suppose A  {1, 2, …, 2n} with |A| = n+1
Write every number in A as a = 2km, where

m is an odd number between 1 and 2n-1
How many odd numbers in {1, …, 2n-1}? n
Since |A| = n+1, there must be two numbers

in A with the same odd part
Say a1 and a2 have the same odd part m.

Then a1 = 2im and a2 = 2jm, so one must
divide the other
We expect your proofs to have three levels:
The first level should be a one-word or

one-phrase “HINT” of the proof
(e.g. “Proof by contradiction,” “Proof by induction,”

“Follows from the pigeonhole principle”)
The second level should be a short one-

paragraph description or “KEY IDEA”
The third level should be the FULL PROOF

DOUBLE STANDARDS?
During the lectures, my proofs will usually

only contain the first two levels and maybe
part of the third
DETERMINISTIC FINITE
AUTOMATA
11 1
0
0,1
1
0111 111 1
0 0
Read string left to right 1
The machine accepts a string if the process

ends in a double circle
A Deterministic Finite Automaton (DFA)
states
0 q1 1
0,1
1
q0 q2
0 0
1
q3 states

A Deterministic Finite Automaton (DFA)
states accept states (F)

0 q1 1
0,1
1
q0 q2
0 0
1
start state (q0) q3 states

NOTATION
An alphabet Σ is a finite set (e.g., Σ = {0,1})
A string over Σ is a finite-length sequence of

elements of Σ
Σ* denotes the set of finite length sequences

of elements of Σ
For x a string, |x| is the length of x

The unique string of length 0 will be denoted
by ε and will be called the empty or null string
A language over Σ is a set of strings over Σ,

ie, a subset of Σ*
A deterministic finite automaton (DFA)
is represented by a 5-tuple M = (Q, Σ, , q0, F) :
Q is the set of states (finite)
Σ is the alphabet (finite)
 : Q  Σ → Q is the transition function
q0  Q is the start state
F  Q is the set of accept states
Let w1, ... , wn  Σ and w = w1... wn  Σ*
Then M accepts w if there are r0, r1, ..., rn  Q, s.t.
• r0=q0
• (ri, wi+1 ) = ri+1, for i = 0, ..., n-1, and
• rn  F
A deterministic finite automaton (DFA)
is represented by a 5-tuple M = (Q, Σ, , q0, F) :
Q is the set of states (finite)
Σ is the alphabet (finite)
 : Q  Σ → Q is the transition function
q0  Q is the start state
F  Q is the set of accept states
L(M) = the language of machine M

= set of all strings machine M accepts
q0 0,1
L(M) = {0,1}*
0 0
1
q0 q1
1
L(M) = { w | w has an even number of 1s}

Build an automaton that accepts all and only
those strings that contain 001
0,1
1 0
0 0 1
q q0 q00 q001
1
A language L is regular if it is
recognized by a deterministic
finite automaton (DFA),
i.e. if there is a DFA M such
that L = L (M).
L = { w | w contains 001} is regular
L = { w | w has an even number of 1’s} is regular

UNION THEOREM
Given two languages, L1 and L2, define
the union of L1 and L2 as
L1  L2 = { w | w  L1 or w  L2 }
Theorem: The union of two regular

languages is also a regular language
Proof: Let
M1 = (Q1, Σ, 1, q01, F1) be finite automaton for L1
and
2
M2 = (Q2, Σ, 2, q0, F2) be finite automaton for L2
We want to construct a finite automaton

M = (Q, Σ, , q0, F) that recognizes L = L1  L2
Idea: Run both M1 and M2 at the same time!
Q = pairs of states, one from M1 and one from M2

= { (q1, q2) | q1  Q1 and q2  Q2 }
= Q1  Q2
1
q0 = (q0, q02)
F = { (q1, q2) | q1  F1 or q2  F2 }
( (q1,q2), ) = (1(q1, ), 2(q2, ))

0
0
1
q0 q1
1 1
1
0
p0 p1
0
1
q0,p0 q1,p0
1
0 0
0 0
1
q0,p1 q1,p1
1
Intersection THEOREM
Given two languages, L1 and L2, define
the intersection of L1 and L2 as
L1  L2 = { w | w  L1 and w  L2 }
Theorem: The intersection of two

regular languages is also a regular
language
FLAC
Read Chapters 0 and 1.1
of the book for next time

Formal Languages, Automata and Computability: WWW - Cs.cmu - Edu/ Emc/flac09

Uploaded by

Formal Languages, Automata and Computability: WWW - Cs.cmu - Edu/ Emc/flac09

Uploaded by

15-453

You must list your collaborators and all

Readings will be posted on the course website.

THEORY CAN DRIVE PRACTICE

THIS STUFF IS USEFUL

A good proof should be:

TRUE or FALSE: There are always two

Show: There is an integer m and elements

Write every number in A as a = 2km, where

How many odd numbers in {1, …, 2n-1}? n

Since |A| = n+1, there must be two numbers

Say a1 and a2 have the same odd part m.

The first level should be a one-word or

(e.g. “Proof by contradiction,” “Proof by induction,”

The second level should be a short one-

The third level should be the FULL PROOF

During the lectures, my proofs will usually

Read string left to right 1

The machine accepts a string if the process

The machine accepts a string if the process

states accept states (F)

The machine accepts a string if the process

A string over Σ is a finite-length sequence of

Σ* denotes the set of finite length sequences

For x a string, |x| is the length of x

A language over Σ is a set of strings over Σ,

L(M) = the language of machine M

L(M) = { w | w has an even number of 1s}

L = { w | w has an even number of 1’s} is regular

Theorem: The union of two regular

We want to construct a finite automaton

Q = pairs of states, one from M1 and one from M2

( (q1,q2), ) = (1(q1, ), 2(q2, ))

Theorem: The intersection of two

You might also like