1 / 43

Computability Theory

Computability Theory. Turing Machines Professor MSc. Ivan A. Escobar iescobar@itesm.mx. Recalling. A finite automata is a computational model that has a limited quantity of memory available. They are good models for devices that have a small amount of memory.

jacksonc
Download Presentation

Computability Theory

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Computability Theory Turing Machines Professor MSc. Ivan A. Escobar iescobar@itesm.mx

  2. Recalling • A finite automata is a computational model that has a limited quantity of memory available. • They are good models for devices that have a small amount of memory. • A pushdown automata is a computational model that has a unlimited quantity of memory available but possesses some restrictions in they way it can use it. • LIFO memory management.

  3. Important Observation • The previous models don’t have the sufficient properties to represent a general purpose computational model.

  4. TMs • We introduce the most powerful of the automata we will study: Turing Machines (TMs) • Invented by Alan Turing in 1936. • TMs can compute any function normally considered computable • Indeed we can define computable to mean computable by a TM

  5. Turing Machines • A Turing machine (TM) can compute everything a usual computer program can compute • may be less efficient • But the computation allows a mathematical analysis of questions like : • What is computable? • What is decidable? • What is complexity?

  6. input State control a a b a - - - A Turing Machine is a theoretical computer consisting of a tape of infinite length and a read-write head which can move left and right across the tape.

  7. Informal definition • TMs uses an infinite memory (tape) • Tape initially contain input string followed by blanks • When started, a TM executes a series of discrete transitions, as determined by its transition function and by the initial characters on the tape

  8. Informal definition • For each transition, the machine checks • what state it is in and what character is written on the tape below the head. • Based on those, it then changes to a new state, writes a new character on the tape, and moves the head one space left or right. • The machine stops after transferring to the special HALT (accept or reject) state. • If TM doesn’t enter a HALT state, it will go on forever

  9. Differences between FA and TMs • A TM can both write on the tape and read from it • The read-write head can move both to the left and to the right • The tape is infinite • The special states of rejecting and accepting take immediate effect

  10. Examples aa,R ba,R aa,R means TM reads the symbol a, it replaces it with a and moves head to right This TM when reading an awill move right one square stays in the same start state. When it scans a b, it will change this symbol to an a and go into the other state (accept state).

  11. Examples • A TM (M1) that tests for memberships in the language • B= {w#w | w belongs to {0,1}*} • We want to design M1 to accept if its input is a member of B. • Idea: • Zig-zag across tape, crossing off matching symbols

  12. Machine M1 Design • M1 makes multiple passes over the input string with the read-write head. • On each pass it matches one of the characters on each side of the # symbol. • To keep track of which symbols have been checked already, M1 crosses off each symbol as it is examined.

  13. Machine M1 Design • If it crosses off all the symbols, that means that everything matched successfully, and M1 goes into an accept state. • If it discovers a mismatch, it enters a reject state.

  14. M1: Algorithm

  15. Examples: M1 a b b # a b b X b b # a b b b X b b # a b b • Tape head starts over leftmost symbol • Record symbol in control and overwrite X • Scan right: reject if blank encountered before # • When # encountered, move right one space • If symbols don’t match, reject

  16. Examples X b b b # X b b X X b # X b b b X X b # X b b • Overwrite X • Scan left, past # to X • Move one space right • Record symbol and overwrite X • When # encountered, move right one space • If symbols don’t match, reject

  17. Examples b X X X # X X X • Finally scan left • If a or b encountered, reject • When blank encountered, accept

  18. Formal Definition • A Turing Machine is a 7-tuple (Q,∑,T, ξ,q0,qaccept, qreject), where • Q is a finite set of states • ∑ is a finite set of symbols called the alphabet • T is the tape alphabet, where – belongs to T, and ∑⊆ T • ξ : Q x T  Q x T x {L,R} is the transition function • q0 Є Q is the start state • qaccept ⊆ Q is the accept state • qreject ⊆ Q is the reject state, where qaccept ≠ qreject

  19. Transition function • ξ : Q x T  Q x T x {L,R} is the transition function ξ(q,a) = (r,b,L) means in state q where head reads tape symbol a the machine overwrites a with b enters state r move the head left

  20. Workings of a TM • M = (Q,∑,T, ξ,q0,qaccept, qreject) computes as follows • Input w=w1w2…wn is on leftmost n tape squares • Rest of tape is blank – • Head is on leftmost square of tape

  21. Workings of a TM • M = (Q,∑,T, ξ,q0,qaccept, qaccept) • When computation starts • M Proceeds according to transition function ξ • If M tries to move head beyond left-hand-end of tape, it doesn’t move • Computation continues until qaccept or qacceptis reached • Otherwise M runs forever

  22. Configurations • Computation changes • Current state • Current head position • Tape contents

  23. Configurations • Configuration • 1011r0111 • Means • State is r • Left-Hand-Side (LHS) is 1011 • Right-Hand-Side (RHS) is 0111 • Head is on RHS 0

  24. Configurations • uarbv yields upacv if • ξ(r,b) = (p,c,L) • uarbv yields uacpv if • ξ(r,b) = (p,c,R) • Special cases: rbv yields pcv if • ξ(r,b) = (p,c,L) • The head moves (tries) to the left, so it only overwrites if it is in the extreme left end. • wris the same aswr– (right hand end)

  25. More configurations • We have • starting configuration q0w • Indicates machine is in a start state q0 with its head at the leftmost position. • accepting configuration w0qacceptw1 • rejecting configuration w0qrejectw1 • halting configurations • w0qacceptw1 • w0qrejectw1

  26. Observations • The accept and reject configurations do not derive in further configurations (or states).

  27. Accepting a language • TM M accepts input w if a sequence of configurations C1,C2,…,Ck exist • C1 is start configuration of M on w • Each Ci yields Ci+1 • Ck is an accepting configuration

  28. TM Language • The collection of strings that M accepts is the language of M, denoted by L(M).

  29. Detailed example

  30. Detailed example

  31. Detailed Example • Do the following test runs: • q10. • q100. • q1000. • q10000.

  32. Detailed Example • Sample run for q10000.

  33. Software: • JFLAP (http://jflap.org) • DEMO:

  34. Exercise 2: • B= {w#w | w belongs to {0,1}*}

  35. Exercise 2 • Design the state transition diagram based on the previous informal definition of the turing machine M3. • Test the diagram with 001101#001101 • Transfer the diagram to JFLAP

  36. State Diagram

  37. Enumerable languages • Definition: A language is (recursively) enumerable if some TM accepts it • In some other textbooks Turing-recognizable

  38. Enumerable languages • On an input to a TM we may • accept • reject • loop (run for ever) • Not very practical: never know if TM will halt

  39. Enumerable languages • Definition: A TM decidesa language if it always halts in an accept or reject state. Such a TM is called a decider • A decider that recognizes some language is said to decide that language. • Definition: A language is decidable if someTM decides it • Some textbooks use recursive instead of decidable • Therefore, every decidable language is enumerable, but not the reverse!

  40. Example of decidable language • Here is a decidable language • L={aibjck | ix j = k, I,j,k > 0} • Because there exist a TM that decides it • How?

  41. Example of decidable language • How? • Scan from left to right to check that input is of the form a*b*c* • Return to the start • Cross off an a and • scan right till you see a b • Mark each b and scan right till you see a c • Cross off that c • Move left to the next b, and repeat previous two steps until all b’s are marked • Unmark all b’s and go to the start of the tape • Goto step 1 until all a’s are crossed off • Check if all c’s are crossed off; if so accept; otherwise reject

  42. TM: Variants • Turing Machine head stays put • Does not add any power • Three possible states for the tape {L,R,S} • Nondetermisim added to TMs • Does not add any power • Halting states may produce transitions.

  43. Remarks • Many models have been proposed for general-purpose computation • Remarkably all “reasonable” models are equivalent to Turing Machines • All ”reasonable” programming languages like C, C++, Java, Prolog, etc are equivalent • The notion of an algorithm is model-independent!

More Related