secondary structure prediction using decision lists
Download
Skip this Video
Download Presentation
Secondary Structure Prediction Using Decision Lists

Loading in 2 Seconds...

play fullscreen
1 / 104

Secondary Structure Prediction Using Decision Lists - PowerPoint PPT Presentation


  • 108 Views
  • Uploaded on

Secondary Structure Prediction Using Decision Lists. Deniz YURET Volkan KURT. Outline. What is the problem? What are the different approaches? How do we use decision lists and why? Why does evolution help?. What is the problem?. The generic prediction algorithm

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Secondary Structure Prediction Using Decision Lists' - riva


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
outline
Outline
  • What is the problem?
  • What are the different approaches?
  • How do we use decision lists and why?
  • Why does evolution help?
what is the problem
What is the problem?
  • The generic prediction algorithm
  • Some important pitfalls: definition, data set
  • Upper and lower bounds on performance
  • Evolution and homology enters the picture
secondary structure
Secondary Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----------HHHHHHHHHH------EEEEE-------

a generic prediction algorithm
A Generic Prediction Algorithm
  • Sequence to Structure
  • Structure to Structure
a generic prediction algorithm sequence to structure
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

??????????????????????????????????????

a generic prediction algorithm sequence to structure1
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

-?????????????????????????????????????

a generic prediction algorithm sequence to structure2
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

-?????????????????????????????????????

a generic prediction algorithm sequence to structure3
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

--????????????????????????????????????

a generic prediction algorithm sequence to structure4
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

--????????????????????????????????????

a generic prediction algorithm sequence to structure5
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

---???????????????????????????????????

a generic prediction algorithm sequence to structure6
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----????????????????????????????

a generic prediction algorithm sequence to structure7
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----H???????????????????????????

a generic prediction algorithm sequence to structure8
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----H???????????????????????????

a generic prediction algorithm sequence to structure9
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HH??????????????????????????

a generic prediction algorithm sequence to structure10
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HHHHHHHHHH------EEEEE------?

a generic prediction algorithm sequence to structure11
A Generic Prediction Algorithm: Sequence to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

?---H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure1
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure2
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

-?--H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure3
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure4
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

--?-H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure5
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----H-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure6
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----?-----HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure7
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----------HHHHHHHHHH------EEEEE-------

a generic prediction algorithm structure to structure8
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----------HHHHHHHHHH------EEEEE------?

a generic prediction algorithm structure to structure9
A Generic Prediction Algorithm: Structure to Structure

MRRWFHPNITGVEAENLLLTRGVDGSFLARPSKSNPGD

----------HHHHHHHHHH------EEEEE-------

pitfalls for newcomers
Pitfalls for newcomers
  • Definition of secondary structure
  • Choice of data set
pitfall 1 definition of secondary structure
Pitfall 1: Definition of Secondary Structure
  • DSSP: H, P, E, G, I, T, S
  • STRIDE: H, G, I, E, B, b, T, C
  • DEFINE: ???
  • Convert all to H, --, and E
  • They only agree 71% of the time!!!

(95% for DSSP and STRIDE)

  • Solution: Use DSSP
pitfall 2 dataset
Pitfall 2: Dataset
  • Trivial to get 80%+ when homologies are present between the training and the test set
  • Homology identification keeps evolving
  • RS126, CB513, etc.
  • Comparison of programs on different data sets meaningless…
performance bounds
Performance Bounds
  • Simple baselines for lower bound
  • A method for estimating an upper bound
performance bounds2
Baseline 2: 49% of all residues are tagged with the most frequent structure for the given amino-acid.Performance Bounds

49%: assign most frequent

43%: assign loop

performance bounds3
Upper bound: Only consider exact matches for a given frame size.

As the frame size increases accuracy should increase but coverage should fall.

Performance Bounds

100% ???

49%: assign most frequent

43%: assign loop

performance bounds4
Upper bound: Only consider exact matches for a given frame size.

As the frame size increases accuracy should increase but coverage should fall.

Performance Bounds

100% ???

75%: estimated upper bound

49%: assign most frequent

43%: assign loop

the miracle of homology
The Miracle of Homology
  • People used to be stuck at around 60%.
  • Rost and Sander crossed the 70% barrier in 1993 using homology information.
  • All algorithms benefit 5-10% from homology.
  • The homologues are of unknown structure, training and test sets still unrelated!
  • Why?
outline1
Outline
  • What is the problem?
  • What are the different approaches?
  • How do we use decision lists and why?
  • Why does evolution help?
slide44
GORV

Sequence

Secondary

Structure

PSI-BLAST

+6.5%

66.9%

Majority Vote

Information

Function / Bayesian

Statistics

Filter

Secondary

Structure

Secondary

Structure

+73.4%

* Garnier et al, 2002

slide45

Frequency Profile

HSSP

Neural Network

Secondary

Structure

PHD

Secondary

Structure

+4.3%

Neural Network

62.6% / 67.4%

Jury +

Filter

+3.4%

Secondary

Structure

70.8%

61.7% / 65.9%

* Rost & Sander, 1993

slide46
JNet

Profile

Secondary

Structure

PSIBLAST

HMMER2

CLUSTALW

Neural Network

Neural Network

Jury +

Jury Network

Secondary

Structure

Secondary

Structure

76.9%

* Cuff & Barton, 2000

psipred
PSIPRED

Secondary

Structure

Profiles

PSI-BLAST

Neural Network

Neural Network

Secondary

Structure

Secondary

Structure

76.3%

* Jones, 1999

outline2
Outline
  • What is the problem?
  • What are the different approaches?
  • How do we use decision lists and why?
  • Why does evolution help?
introduction to decision lists
Introduction to Decision Lists
  • Prototypical machine learning problem:
    • Decide democrat or republican for 435 representatives based on 16 votes.

Class Name: 2 (democrat, republican)

1. handicapped-infants: 2 (y,n)

2. water-project-cost-sharing: 2 (y,n)

3. adoption-of-the-budget-resolution: 2 (y,n)

4. physician-fee-freeze: 2 (y,n)

5. el-salvador-aid: 2 (y,n)

6. religious-groups-in-schools: 2 (y,n)

16. export-administration-act-south-africa: 2 (y,n)

introduction to decision lists1
Introduction to Decision Lists
  • Prototypical machine learning problem:
    • Decide democrat or republican for 435 representatives based on 16 votes.

1. If adoption-of-the-budget-resolution = y

and anti-satellite-test-ban = n

and water-project-cost-sharing = y

then democrat

2. If physician-fee-freeze = y

then republican

3. If TRUE then democrat

rule search

+ -

Rule Search
  • Initially evertyhing is predicted to be the mostly seen structure (i.e. loop)

False Assignments

Correct

Assignments

Training Set

Partition with respect to the Base Rule

rule search1

+ -

Rule Search
  • At each step add the maximum gain rule

+

-

-

+

Partition with respect to the Second Rule

Partition with respect to the Base Rule

gpa rule s
GPA Rules
  • The first three rules of the sequence-to-structure decision list
    • 58.86% performance (of 66.36%)
gpa rule 1
GPA Rule 1
  • Everything => Loop
slide58
GPA

Sequence

Secondary

Structure

PSI-Blast

+6.67%

GPA

GPA

Secondary

Structure

Secondary

Structure

60.48%

62.54% / 69.21%

experimental setup
Experimental Setup
  • DSSP assignments
  • Reduction:
    • E (extended strand), B (b bridge)-> Strand
    • H (a helix ), G (3-10 helix) -> Helix
    • Others -> Loop
  • Data set:
    • CB513 set
    • 7-fold cross-validation
gpa performance
GPA Performance
  • Performance of seq-to-struct decision list:
    • Without homologs: 60.48% (29 to 66 rules)
    • With homologs: 66.36% (46 to 68 rules)
  • Performance withstruct-to-structfilter:
    • Without homologs: 62.54% (18 to 116 rules)
    • With homologs: 69.21% (16 to 40 rules)
gpa performance1
GPA Performance
  • Performance at 20 rules at both steps:
    • Without homologs: 62.15%
    • With homologs: 69.08%
  • Possible to make a back-of-the-envelope structure prediction using our model
comparison on cb513
Comparison on CB513
  • PhD 72.3
  • NNSSP 71.7
  • GPA 69.2
  • DSC 69.1
  • Predator 69.0
outline3
Outline
  • What is the problem?
  • What are the different approaches?
  • How do we use decision lists and why?
  • Why does evolution help?
discussion
Discussion
  • Training set homologues and test set homologues help for different reasons.
  • Training set homologues use semi-accurate guesses of structure to provide information on amino-acid substitutions
  • Test set homologues take advantage of “independent errors” in prediction
  • The less similar the homologue sequences the better…
summary
Summary
  • Homologues between the training set and the test set unfairly influence results.
  • Homologues within the training set and the test set still help significantly.
  • There is an upper bound at around 75% unless we use a homologue of the target protein.
  • Very different learning algorithms converge on comparable accuracy.
some educated guesses
Some Educated Guesses
  • Significant progress probably requires better homology detection rather than better learning algorithms.
  • To exceed the 75% bound one needs to start incorporating long range interactions.
  • CASP shows predicting tertiary structure first gives compatible results – any use for secondary structure?
thank you
Thank you…
  • The algorithm, the paper, etc. available from:

[email protected]

introduction
Introduction
  • Protein Structure
    • What is Secondary Structure?
    • What is Tertiary Structure?
  • Secondary structure Prediction
    • What are decision lists?
    • GPA in Action
  • Tertiary Structure Prediction
protein structure
Protein Structure
  • Primary Structure
    • Sequences
  • Secondary Structure
    • Frequent Motifs
  • Tertiary Structure
    • Functional Form
  • Quaternary Structure
    • Protein complexes
primary structure
Primary Structure
  • Sequence information
  • Contains only aminoacid sequences
    • 24 amino acid codes present
    • 20 standard residues
    • Glutamine or Glutamic Acid  GLX (GLU)
    • Asparagine or Aspartic Acid  ASX (ASN)
    • Others (Non-natural/Unknown)  X
      • Selenocysteine, Pyrrolysine
secondary structure1
Secondary Structure
  • Rigid structure motifs
  • Do not give information about coordinates of residues
  • Can be seen as a one-dimensional reduction of the tertiary structure
  • If accurately predicted, can be used to
    • Predict the final (tertiary) structure
    • Predict the fold type (all-alpha/all-beta etc.)
common secondary structure motifs
Common Secondary Structure Motifs

Parallel beta-sheet

alfa-helix

Antiparallel beta-sheet

tertiary quaternary structure2
Tertiary/Quaternary Structure
  • Tertiary Structure
    • The functional form
    • Coordinates of residues in the space
  • Quaternary Structure
    • Protein – Protein complexes
    • Assembly of one or more proteins
structure prediction
Structure Prediction
  • Easier to determine sequence than structure
  • Predictions may help close the gap
secondary structure prediction
Secondary Structure Prediction
  • Assesment of Prediction Accuracy
  • Common Strategy
  • Methods in Literature
  • Decision Lists
    • Prediction using GPA
  • A Performance Bound
secondary structure prediction1
Secondary Structure Prediction
  • Predictions based on
    • Sequence Information
    • Multiple Sequence Alignments
  • Various algorithms present based on
    • Information Theory
    • Machine Learning
    • Neural Networks etc.
assessment of accuracy
Assessment of Accuracy
  • Determination method
    • DSSP
  • Performance Metric
    • Q3 accuracy
    • Three state accuracy (helix/strand/loop)
  • Data set selection
    • Non-redundancy
  • Homology Information
    • Multiple Sequence Alignments
  • Cross-Validation
two levels of prediction
Two Levels of Prediction

Sequence

  • First Level:
    • Sequence to Structure
  • Input:
    • Sequence Information
    • Multiple Sequence Alignments
  • Method:
    • Machine Learning
    • Neural Networks
  • Output
    • Secondary Structure

MSA

Sequence to

Structure

Secondary

Structure

two levels of prediction1
Two Levels of Prediction

Secondary

Structure

  • Second Level:
    • Structure to Structure
  • Input:
    • Structure Information
  • Method:
    • Machine Learning
    • Neural Networks
    • Filter
      • Simple Filters
      • Jury Decisions
  • Output
    • Secondary Structure

Structure to

Structure

Filter

Secondary

Structure

decision lists
Decision Lists
  • Machine Learning method
  • Simply, a list of rules
  • Each rule asserts a guess
  • Generalization by simple rule pruning
  • Output is human readable/understandable
slide82
GPA
  • Greedy Decision List
  • Start with a global (base) rule
  • At every step
    • Find the maximum gain rule
    • Append to previous list
  • Stop when gain change is 0
data representation
Data Representation
  • Frames of length W
    • Context of an aminoacid is represented by W residues
    • (W-1)/2 to the left. (W-1)/2 to the right
    • If the frame exceeds terminii, they are represented as NAN
    • GLX = GLN. ASX = ASN.
    • New found/Non Natural aa’s = X
sample data

helix

Sample Data
  • evealekkv[aaLes]vqalekkvealehg
  • Frame Size = 5
  • Represents the features used in the prediction of secondary structure for L (leucine)
2 level algorithm
2-level Algorithm
  • Sequence to Structure List
    • Find the first rule that matches the data point
    • Assign the output of that rule
    • A frame of 9 residues is input
    • Output: Secondary Structure
  • Structure to Structure List
    • After all predictions are made, check for possible improvements
    • A frame of 19 secondary structures is input
    • Output: Secondary Structure
discussion why gpa
Discussion - Why GPA?
  • Amazingly simple models
    • With as low as 20 rules in the first level and as low as 20 rules in the second
  • Rules (Models) are human-readable
    • Biological rules may be inferred
  • Second level decision list may be used as a filter for other algorithms
a performance bound claim
A Performance Bound Claim
  • Using only sequence information. the highest achievable performance has an upper bound
  • The lower bound:
    • 43%. with everything assigned as loop
    • 49%. with every residue assigned the most probable structure
  • The upper bound
    • 75%. with non-homologous data
a performance bound claim1
A Performance Bound Claim
  • Bound is calculated by:
    • Taking only the exact sequence matches in the training and testing sets
    • Assign the mostly seen value of that frame in the training set as guess
    • Compare with actual value
  • A bound for non-homologous training and testing sets
  • A bound for carefully selected frame size
    • Not too short (assignments would be almost random)
    • Not too long (only unique frames will be available)
tertiary structure prediction
Tertiary Structure Prediction
  • Predictions based on backbone dihedral angles
    • Phi and Psi angles fully define the tertiary structure
  • Goal:
    • Discover the right level of granularity
data set selection
Data Set Selection
  • PDB-Select
    • A set of non-homologous proteins of high resolution [Hobohm & Sander, 1994]
  • Data representation
    • Frames of 9 residues
    • Residue names plus residue properties
      • Hydrophobicity, polarity, volume, charge etc.
  • Train/Validation/Test
data discretization
Data Discretization
  • Phi/Psi angles are continuous
    • We need a discrete representation to predict them in a decision list
  • Split the (-180, 180) region into bins
  • Split the Ramachandran into bins
ramachandran plot 2
Ramachandran Plot (2)

* Karplus, 1996

how to predict
How to Predict?
  • Predictions using sequence information
    • No homology information
  • Predicted angles may be incorporated
    • Upper bounds will be given
  • Accuracy
    • Percent of correct estimates
    • RMSD of phi and psi angles
future work
Future Work
  • For tertiary structure predictions.
    • The two-leveled approach may be applied to tertiary structure predictions
    • Homology information may be incorporated
  • For secondary structure predictions.
    • Should find better homologues and better representations
    • Incorporating sequence and homology information in the structure to structure part may be an option
  • For both predictions
    • A reliability index for predicted structure
ad