Chapter 1: Introduction

1. Chapter 1: Introduction • Purpose of Database Systems • View of Data • Data Models • Data Definition Language • Data Manipulation Language • Transaction Management • Storage Management • Database Administrator • Database Users • Overall System Structure

2. Database Management System (DBMS) DBMS contains information about a particular enterprise Collection of interrelated data Set of programs to access the data An environment that is both convenient and efficient to use Database Applications: Banking: transactions Airlines: reservations, schedules Universities: registration, grades Sales: customers, products, purchases Online retailers: order tracking, customized recommendations Manufacturing: production, inventory, orders, supply chain Human resources: employee records, salaries, tax deductions Databases can be very large. Databases touch all aspects of our lives

3. University Database Example Application program examples Add new students, instructors, and courses Register students for courses, and generate class rosters Assign grades to students, compute grade point averages (GPA) and generate transcripts In the early days, database applications were built directly on top of file systems

4. Drawbacks of using file systems to store data Data redundancy and inconsistency Multiple file formats, duplication of information in different files Difficulty in accessing data Need to write a new program to carry out each new task Data isolation — multiple files and formats so difficult retrieve. Integrity problems Integrity constraints (e.g., account balance > 0) become “buried” in program code rather than being stated explicitly Hard to add new constraints or change existing ones

5. Drawbacks of using file systems to store data (Cont.) Atomicity of updates Failures may leave database in an inconsistent state with partial updates carried out Example: Transfer of funds from one account to another should either complete or not happen at all Concurrent access by multiple users Concurrent access needed for performance Uncontrolled concurrent accesses can lead to inconsistencies Example: Two people reading a balance (say 100) and updating it by withdrawing money (say 50 each) at the same time Security problems Hard to provide user access to some, but not all, data Database systems offer solutions to all the above problems

6. Some Commercial Database Management Systems Microsoft Access FoxPro dBase Oracle – Oracle 8i, Oracle9i, Oracle 10g Microsoft SQL Server IBM DB2/DB2UDB Informix Sybase MySQL Ingress Postgre SQL

7. Data Models A collection of conceptual tools for describing Data Data relationships Data semantics Data constraints Relational model : Collection of tables to represent both data & the relationship among the data Entity-Relationship data model (mainly for database design) Object-based data models (Object-oriented and Object-relational) Semi structured data model (XML): this model permits the specification of data where individual data items of the same type have different sets of attribute. Other older models: Network model Hierarchical model

8. Relational Model Relational model (Chapter 2) Example of tabular data in the relational model Columns Rows

9. A Sample Relational Database

10. Entity-Relationship Model Example of schema in the entity-relationship model

11. Entity Relationship Model (Cont.) • E-R model of real world • Entities (objects) • E.g. customers, accounts, bank branch • Relationships between entities • E.g. Account A-101 is held by customer Johnson • Relationship set depositor associates customers with accounts • Widely used for database design • Database design in E-R model usually converted to design in the relational model (coming up next) which is used for storage and processing

12. Database Language • A database system provides a data-definition language to specify the database schema and a data-manipulation language to express database queries and update.

13. Data Definition Language (DDL) Specification notation for defining the database schema Example: create tableinstructor (IDchar(5),name varchar(20),dept_name varchar(20),salarynumeric(8,2)) DDL compiler generates a set of table templates stored in a data dictionary Data dictionary contains metadata (i.e., data about data) Database schema Integrity constraints Primary key (ID uniquely identifies instructors) Referential integrity (references constraint in SQL) e.g. dept_name value in any instructor tuple must appear in department relation Authorization

14. SQL SQL: widely used non-procedural language Example: Find the name of the instructor with ID 22222select namefrom instructorwhereinstructor.ID = ‘22222’ Example: Find the ID and building of instructors in the Physics dept. select instructor.ID, department.buildingfrom instructor, departmentwhere instructor.dept_name = department.dept_name and department.dept_name = ‘Physics’ Application programs generally access databases through one of Language extensions to allow embedded SQL Application program interface (e.g., ODBC/JDBC) which allow SQL queries to be sent to a database Chapters 3, 4 and 5

15. Database Design? Is there any problem with this design?

16. Design Approaches Normalization Theory (Chapter 8) Formalize what designs are bad, and test for them Entity Relationship Model (Chapter 7) Models an enterprise as a collection of entities and relationships Entity: a “thing” or “object” in the enterprise that is distinguishable from other objects Described by a set of attributes Relationship: an association among several entities Represented diagrammatically by an entity-relationship diagram:

17. An Un-normalized Relation for ORDER

18. Normalized Tables Created from ORDER

19. Database Users Users are differentiated by the way they expect to interact with the system. Four different types: 1. Naive users – are unsophisticated users who interact with the system by invoking one of the permanent application programs that have been written previously. E.g. people accessing database over the web, bank tellers, clerical staff

20. Database Users 2. Application programmers – are computer professionals who write application programs. Application programmers can choose from many tools to develop user interface. 3. Sophisticated users – interact with the system without writing programs. Instead, they form their requests in a database query language. Analysts who submits queries to explore data in the database. e.g., analyst looking at sales data (OLAP – Online analytical processing), data mining – finds certain kinds of patterns in data. 4. Specialized users – are sophisticated users who write specialized database applications that do not fit into the traditional data processing framework. e.g., computer-aided design systems, knowledge-base and expert systems and environment-modeling systems – uses complex data types.

21. Database Administrator (DBA) Coordinates all the activities of the database system; the database administrator has a good understanding of the enterprise’s information resources and needs. DBA has central control of both data and the programs that access that data. The functions of Database administrator (DBA) include: Schema definition Storage structure and access method definition Schema and physical-organization modification Granting of authorization for data access

22. Transaction Management A transaction is a collection of operations that performs a single logical function in a database application _ e.g., deposit, withdrawal, transfer between accounts A – Atomicity, C – Consistency, I – Isolation, D - Durability

23. Transaction Management Transaction-management component ensures that the database remains in a consistent (correct) state despite system failures (e.g., power failures and operating system crashes) and transaction failures _ e.g., system crash cannot wipe out “committed” transactions

24. Storage Manager A storage manager is a program module that provides the interface between the low-level data stored in the database and the application programs and queries submitted to the system. The storage manager translates the various DML statements into low-level file system thus The storage manager is responsible for _efficient storage, retrieval and updating of data in the database. The storage manager components include : Authorization & Integrity manager: : test for satisfaction of integrity constraints and checks the authority of user to access data. Transaction manager: which ensure that the database remains in a consistent despite of power failure. File Manager: Which manages the allocation of space on disk storage & the data structures used to represent information stored on disk. Buffer Manager : Which is responsible for fetching data from disk storage into main memory, and deciding what data to cache in main memory.

25. Storage Manager The storage manager stores: Data files (relations): which stores the database itself. Data dictionary : Which stores metadata about structure of the database, in particular the schema of the database. (sometimes called catalog) Indices : which can provide fast access to dataItems. Like Index of a text book.

26. The Query Processor Components include: 1. DDL interpreter : Which Interprets DDL statements and records the definitions in the dictionary. 2. DML compiler : Which translates DML statements in a query language into an evaluation plan consisting of low level instruction that the query evaluation engine understand. 3. Query evaluation engine : Which execute low-level instructions generated by the DML compiler.

27. Database Administrator • Coordinates all the activities of the database system; the database administrator has a good understanding of the enterprise’s information resources and needs. • Database administrator's duties include: • Schema definition • Storage structure and access method definition • Schema and physical organization modification • Granting user authority to access the database • Specifying integrity constraints • Acting as liaison with users • Monitoring performance and responding to changes in requirements

28. Overall System Structure

29. Application Architectures • Two-tier architecture: E.g. client programs using ODBC/JDBC to communicate with a database • Three-tier architecture: E.g. web-based applications, and applications built using “middleware”

30. Query Processing 1. Parsing and translation 2. Optimization 3. Evaluation

31. Transaction Management What if the system fails? What if more than one user is concurrently updating the same data? A transaction is a collection of operations that performs a single logical function in a database application Transaction-management component ensures that the database remains in a consistent (correct) state despite system failures (e.g., power failures and operating system crashes) and transaction failures. Concurrency-control manager controls the interaction among the concurrent transactions, to ensure the consistency of the database.

32. Database System Internals

33. Database Architecture The architecture of a database systems is greatly influenced by the underlying computer system on which the database is running: Centralized Client-server Parallel (multi-processor) Distributed

34. History of Database Systems 1950s and early 1960s: Data processing using magnetic tapes for storage Tapes provided only sequential access Punched cards for input Late 1960s and 1970s: Hard disks allowed direct access to data Network and hierarchical data models in widespread use Ted Codd defines the relational data model Would win the ACM Turing Award for this work IBM Research begins System R prototype UC Berkeley begins Ingres prototype High-performance (for the era) transaction processing

35. History (cont.) 1980s: Research relational prototypes evolve into commercial systems SQL becomes industrial standard Parallel and distributed database systems Object-oriented database systems 1990s: Large decision support and data-mining applications Large multi-terabyte data warehouses Emergence of Web commerce Early 2000s: XML and XQuery standards Automated database administration Later 2000s: Giant data storage systems Google BigTable, Yahoo PNuts, Amazon, ..