data hierarchy in oracle n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Data Hierarchy in Oracle PowerPoint Presentation
Download Presentation
Data Hierarchy in Oracle

Loading in 2 Seconds...

play fullscreen
1 / 49

Data Hierarchy in Oracle - PowerPoint PPT Presentation


  • 97 Views
  • Uploaded on

Data Hierarchy in Oracle. Data hierarchy in Oracle is specific (and cumbersome! Usually a DBA job) Normally, unit of storage is file… Managed by OS Can grow / shrink Physical sections logically connected by OS In Oracle a DB = one or more tablespaces One or more objects, indexes, clusters…

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Data Hierarchy in Oracle' - joey


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
data hierarchy in oracle
Data Hierarchy in Oracle
  • Data hierarchy in Oracle is specific (and cumbersome! Usually a DBA job)
  • Normally, unit of storage is file…
    • Managed by OS
    • Can grow / shrink
    • Physical sections logically connected by OS
  • In Oracle a DB = one or more tablespaces
    • One or more objects, indexes, clusters…
    • Fixed size – gets full (Extended by DBA)
    • Many admin functions at this level
terminology
Terminology
  • File: physical entity for storing data on disk
  • Segment: collection of extents for a particular object
  • Extent: unit of disk storage made up of contiguous blocks
  • Blocks: sizing of smallest piece of database data decided upon when db created
  • (Block – OS)
create a tablespace
Create a Tablespace
  • Create tablespace myTS datafile

‘path\myTS.dbf’ size 1000K

Default storage (initial 10K next 10K

Minextent 1 maxextents 100

Pctincrease 0)

Permanent;

  • 10 10 10 10 10 10 10 10 10 10
  • 20 30 40 50 60 70 80 90 100
  • 10 10 12 14.4 17.2 20.7 25 30 36 42.3
  • 10 20 32 46.4 63.6 84.3 109.3 139.3 175.3 218.5
about tablespaces
About Tablespaces
  • Kind of partitioning
    • Easier to deal with small ones
    • Inc. monitor perf.
    • Oracle very strong at TS level
  • Optimal seems to be around 2GB
  • Strategy = isolate aged data into one tablespace => can be made read-only
  • Should have same size extents
    • Contiguous blocks
reasoning behind ts creation
Reasoning behind TS creation
  • Business relevance
  • Size / type of objects
  • Type of activity
  • Volume of activity
  • Backup
  • Transportability
  • Time-based changes in activity
slide6

Reasoning behind TS creation

  • Business relevance
  • Size / type of objects
  • Type of activity
  • Volume of activity
  • Backup
  • Transportability
  • Time-based changes in activity

e.g. modular design / keep data together

Object of similar sizes – reuse of space

e.g. index VS table / full scan VS rowID

Low I/O VS high I/O objects

TS is smallest unit for Bcup and restore

Cloning copy is done by TS as well

Eg: DW versus OLTP systems

block size
Block Size
  • Smallest unit of oracle DB
  • Critical perf. Factor as inefficient space use leads to increase I/O activity
  • Block overhead
    • Integrity section (90 bytes)
    • Runtime overhead (136 bytes)
    • Transactional header (24 bytes and growing)
    • Directory section (Pointers…)
    • And then………..data
  • Big is beautiful? Percentage of overhead decreases when block size increases, but no right answer here

}

Approx. 256 b

2 k 4k or 16k
2 K, 4K or 16K?
  • OLTP prefer smaller – small granularity increase likelihood that data is in buffer (indexed access)
  • DW or DSS prefer larger – physically close data used together + less movement
  • In practice constraint on memory will dictate
  • Buffer size + now split in 3 areas:
    • KEEP pool
    • RECYCLE pool
    • DEFAULT pool
then there was a table
Then, there was a table
  • Tables = one physical space on disk [segment] – same for any object
  • Each segment = space set out in tablespace [initial extent]
  • When table grows allocate next extent – set of adjacent blocks
  • Until tablespace is full
  • Look again at figure 20.3
what a segment looks like
What a Segment Looks Like
  • Each segment contains a header block
  • Space directory for other blocks
  • Properly sized tables = few extents (low fragmentation)
  • Additional extents are never lost until drop or delete commands are used
  • Can also adjust pctfree value (to fill a Null value column)
sizing extents
Sizing Extents
  • Try to match the max capacity of your storage device to limit I/O operations
    • eg: minimal read size of OS (64K?)
  • For single objects, It is beneficial to keep extents of same size (deletion)
  • Try to limit the number of extents below 50 (measure of the growth of the object)
  • If too many, rebuild object with larger size extents
roll back segments
Roll Back Segments
  • Special case of segment to hold the before image of DB while transactions take place
  • Should be stored in separate TS because specific behaviour:
    • Cyclical rather than random access pattern
    • Set of segments that gets written and written over
    • Then written to disk
    • Best used when “Hot”
  • RB Segments grow to be big enough to hold complete transacs (cannot span segments)
oracle space allocation
Oracle “Space Allocation”
  • DBA allocates space for table after 2 days of hard thinking
  • Oracle ignores it blatantly as follows:

Table name initial size next extent oracle sizing next extent

Smalltab 7K 7K 20K 20K

Mediumtab 103K 103K 120K 120K

Total size after growth smalltab = 40K instead of 14K

mediumtab = 206K instead of 240K

creating and using tables
Creating and Using Tables
  • Table creation with CREATE TABLE statement
  • Syntax:

Create table NAME (

field1 datatype special constraint

field2 datatype etc…

);

  • Special constraint: e.g. NOT NULL or PRIMARY KEY or CHECK
constraints
Constraints
  • Candidate key:

Create table Customer (

name varchar2(10) NOT NULL

firstname varchar2(10) NOT NULL

age number

Constraint Customer _UQ unique (name, firstname)

);

primary key
Primary Key

Create table Customer (

name varchar2(10)

firstname varchar2(10)

age number

Constraint Customer _PK Primary Key (name, firstname)

);

  • Same apart: always NOT NULL + can only have one of them in a table
  • If only one field just list primary key as special constraint
foreign key aka referential integrity constraint
Foreign key – aka referential integrity constraint

Create table Customer (

ID number NOT NULL

name varchar2(10)

firstname varchar2(10)

age number

Constraint Customer _PK Primary Key (ID), foreign key (age) references OTHERTAB(age)

);

  • Use ON DELETE CASCADE to maintain constraint
  • Can use DEFERRAL mode
check constraint
Check Constraint

Create table Customer (

ID number NOT NULL

name varchar2(10)

firstname varchar2(10)

age number CHECK (age between 18 and 65)

);

deleting data
Deleting Data
  • Drop table statement – remove table
  • Or truncate table statement – empty it
  • Warning: neither can be rolled back
  • Otherwise:

Alter table NAME Add (…)

Alter table NAME modify (…)

drop column fieldname

now what clusters
Now what? Clusters
  • To store different tables in physically close areas on disk
  • Create a cluster to store both objects
  • Cluster key is any useful field that links the tables
  • Can keep name of field or pick new one
    • e.g. Create cluster fred (name datatype)
    • then assign tables: create table…cluster fred (name)
what this cluster looks like
What this Cluster Looks Like
  • 12 Cork John O’Donoghue Irish
  • Midleton Francesca Bianco Italian
  • Bally… Brian Hayes English

Table 1

Table 2

Cluster Key

finally
Finally…
  • Users can have different logical views on a database
  • These views are called Schemas
  • They allow for a re-organisation of physical DB objects for each users
  • Each schema can contain elements from different tablespaces
  • Has limited size allocated to each user
summary storage in oracle
Summary: Storage in Oracle
  • Keywords: tablespace / datafiles / database objects / segments / extents
  • When you create an object:
    • Specify size / tablespace info = storage clause
    • Otherwise: default values
  • Pctincrease should be used with care (affects re-usability of reclaimed space – i.e. extents)
  • Wise use of tablespace eases admin (like partitioning)
    • sizing follows sizing of device – e.g. 2GB
    • Many utilities to work with tablespaces
    • Isolate processes – e.g. a report running inside a TS
    • Also for archiving (move to read only – huge perf. gains)
i o performance issues
I/O Performance Issues
  • Extent sizing a key
  • Oracle has 2 ways to read data:
    • By rowID – typically thru an index
    • Full table scan
  • In second case, oracle reads several blocks at a time
    • Set with DB_FILE_MULTIBLOCK_READ_COUNT
    • Limited only by I/O device buffer capacity
    • E.g. block = 4K, I/O buffer = 64K => ?????
    • Extent size should be multiple of 64K
example
Example
  • Table with 10 extents 64 K each
  • I/O device buffer = 64K => 10 reads
  • If extent = 640K => ???? Reads
  • If 8 extents 80K each => ??? Reads
    • Reads cannot span extents => 16 reads or an increase of 60% in I/O operations
  • Cl: either use extents much larger than buffer or use multiple of buffer size
and for roll back segments
And for Roll Back Segments
  • Should be kept small enough
  • Current wisdom is to ensure TS for rollback is normally 50% free
  • Not always possible to use only one RB size
    • For different types of processes – e.g. TPS
    • Use two different TS to isolate activates
    • Easier trouble shooting
  • Discarded rollback segments go into the log file
data utilities
Data Utilities
  • ORACLE is king of data handling
  • Export: to transfer data between DBs
    • Extract both table structure and data content into dump file
  • Import: corresponding facility
  • SQL*loader automatic import from a variety of file formats into DB files
    • Needs a control file
control files using sqlloader
Control files: Using SQLloader
  • Data tranfers in and out of DB can be automated using the loader
    • Create a data file with the data(!)
    • Create a control file to guide the operation
  • Load creates two files
    • Log file
    • “bad transactions” file
  • Also a discard file if control file has selection criteria in it
querying the oracle db
Querying the Oracle DB
  • 2 main methods:
    • Full scan – TABLE ACCESS FULL
    • Direct access – TABLE ACCESS BY ROWID
  • When spelling out queries – drop HINT using syntax: /*+ HINT */
  • This invokes the OPTIMISER
    • RBO (Rule Based Optimiser)
    • CBO (Cost Based Optimiser)
example1
Example:
  • Accessing the worker field in the worker table:
  • By default full scan (+ when no where statement)
  • else

Select /*+ FULL(worker)*/

From worker

Where lodging = ‘Rose Hill’

Select /*+ ROWID(worker)*/

………

  • For low hit ratio
  • need index or rowid value
effect of primary key constraints
Effect of Primary key Constraints
  • No index by default
  • When primary key added = > index created
  • Name given will be same as name of primary key (e.g. TABLE_PK)
  • PK indexes are of UNIQUE kind
  • Other non-unique indexes can be created on other fields
  • CREATE INDEX name ON table(field) TABLESPACE indexes
using the index
Using the Index
  • Query with “where” clause on PK
  • First the PK index is accessed in INDEX UNIQUE SCAN mode
  • Matching Rowid is retrieved and returned
  • Second: access table with ROWID as argument in TABLE ACCESS BY ROWID mode
  • When value sought is in index, no need to read table at all
index range scan
Index Range Scan
  • If query based on range of values / non-unique index
    • E.g. field like’M%’
  • More than one value returned => IRS
  • Less efficient
  • Especially if values are not in index => IRS followed by table rowid access
  • Another reason why index creation important
multiple index scans
Multiple Index Scans
  • When more than one value in WHERE clause
  • Two indexes can be used to produce two scans of range values
  • Then concatenation of scans
  • Result of the query
  • Broadly similar to cross-reference of bitmap indexes
database creation
Database Creation
  • Using a script:

Connect internal as sysdba;

create database NAME….;

  • Using the OEM (Oracle Enterprise Manager) GUI
    • Parameters stored in a small DB
    • Access to other utility pgms – eg: RMAN (recovery manager)
    • Can accommodate several DBAs
  • Key decisions on sizing
    • eg: assign a block size – once and for all
slide37
OEM (Oracle Enterprise Manager)
    • is a set of systems management tools provided by Oracle Corporation for managing the Oracle environment. It provides tools to monitor the Oracle environment and automate tasks (both one-time and repetitive in nature) to take database administration a step closer to "Lights Out" management.
opening and closing the db
Opening and Closing the DB

Startup open NAME;

Or

Startup mount NAME;

Alter database open;

Shutdown;

else – use OEM menus

when a db is started
When a DB is Started

System Global Area (SGA) created: (282)

Data block buffer cache created

  • Size is key for performance of DB
  • typically 2% of whole DB
  • DB_BLOCK_BUFFERS / DB_BLOCK_SIZE
  • Least Recently Used (LRU) method
  • Too small means fight for space between objects => increase in misses => increase in I/O
  • Too big = crippling for other operations
slide40

http://www.databasejournal.com/features/oracle/article.php/10893_3350331_2http://www.databasejournal.com/features/oracle/article.php/10893_3350331_2

when db is started
When DB is Started

Shared SQL Pool created:

  • Stores DD (data dictionary) cache: info about data structure
  • Stores library cache: info about SQL statements run
  • LRU algorithm
  • Too small => no re-use and low performance
  • SHARED_POOL_SIZE in init.ora
    • (http://www.dba-oracle.com/t_init_ora.htm)
parameter files init ora
Parameter Files: INIT.ORA
  • Initialisation file for each DB
  • MYDB = > initmydb.ora
  • Contains sizing of SGA and number of background processes, DB name and block size
  • Read at startup means changes only implemented at next startup
the control file
The Control File
  • Each DB also has a control file
  • Contains Dbname, name and location of files and redo logs, timestamp of DB creation
  • Can be mirrored for added security
  • Identifies all files that must be opened when DB is loaded
  • Also used in DB recovery
the redo function
The REDO Function
  • Very Hot redo is located in buffer – on-line redo
  • Semi-Hot redo is kept in redo log files – archived redo
  • Limit to how much can reasonably be held
  • So ORACLE organises hot backups of the DB
  • Redo files up to that point can then be discarded
  • Needs to run in ARCHIVELOG mode
backups
Backups
  • When DB is offline
    • Datafiles
    • Control file
    • On-line redo
    • Init.ora
  • Stores a complete workable DB
  • Does not work when DB is running
  • Not to be trusted after abort shutdown
on line backups
On-line Backups
  • When running in ARCHIVELOG mode
  • 3 distinct redo log files
    • When one full moves to next one
    • After 3, overwrite first one
  • Archiver background process backs up each redo file before overwriting it – to disk
  • Automatic recovery from on-line backup
    • When DB started all failed transactions rerun or roll back
  • Else, limited back up
recovery manager
Recovery Manager
  • Takes redo logs on by one and checks transactions
  • Warning redo files cannot be skipped in the sequence of recovery
  • Options:
    • Level 0: all blocks ever used
    • Level 1: all blocks used since last full Bup
    • Level 2: only those changed last Bup
    • Huge impact on Bup performance
other functions
Other Functions
  • Archiving
  • Locking
  • Logwriting
  • Data writing
  • Recovering
  • Job queues
  • System monitor
  • Process monitor
database creation non data objects
Database Creation – Non-Data Objects
  • DBs contain number of compulsory objects
  • Create / assign tablespaces
  • System tablespace
    • Data dictionary
    • Names and locations of all tablespaces, indexes and clusters of DB
    • Files name / location (multiple instances)
    • Rollback segments
  • Data tablespaces are separate