Tips when using bibliometrics
Download
1 / 12

TIPS WHEN USING BIBLIOMETRICS - PowerPoint PPT Presentation


  • 119 Views
  • Uploaded on

TIPS WHEN USING BIBLIOMETRICS. UNITED KINGDOM OCTOBER 2010. USING BIBLIOMETRICS IN CITATION ANALYSIS. The Development of Publication and Citation Analysis Bibliometrics and Peer Judgment: A Two-Pronged Approach. Medical Country. Large data sets (nations, regions, large institutions).

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' TIPS WHEN USING BIBLIOMETRICS' - naiara


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Tips when using bibliometrics

TIPS WHEN USING BIBLIOMETRICS

UNITED KINGDOM

OCTOBER 2010


Using bibliometrics in citation analysis
USING BIBLIOMETRICS IN CITATION ANALYSIS

  • The Development of Publication and Citation Analysis

  • Bibliometrics and Peer Judgment: A Two-Pronged Approach


One consider whether available data can address the question

Medical

Country

Large data sets

(nations, regions, large institutions)

ModerateConfidence

HighConfidence

Engineering &

Applied Sciences

Fundamental &

Basic Sciences

LowConfidence

ModerateConfidence

Social Sciences

Individual

Small data sets

(small departments, individual researchers)

ONE: CONSIDER WHETHER AVAILABLE DATA CAN ADDRESS THE QUESTION


Two choose publication types field definitions and years of data
TWO: CHOOSE PUBLICATION TYPES, FIELD DEFINITIONS AND YEARS OF DATA

  • Publication types

    • Research Articles

    • Notes

    • Review articles

  • Field definitions

    • Difficulties with characterization

  • Time frame

    • Citation lag


Three decide on whole or fractional counting
THREE: DECIDE ON WHOLE OR FRACTIONAL COUNTING OF DATA

68 authors

17 institutions

18 citations


Four judge whether data require editing to remove artifacts
FOUR: JUDGE WHETHER DATA REQUIRE EDITING TO REMOVE ARTIFACTS OF DATA

  • Artifacts of variation

    • Institution names

      • Heidelberg Univ, Heidelberg Univ Clin, Heidelberg Univ Educ, Heidelberg Univ Hosp, Heidelberg Univ I, Heidelberg Univ II, Univ Heidelberg, Univ Heidelberg BZH, Univ Heidelberg Cardiol, Univ Heidelberg Clin, Univ Heidelberg Hosp, Univ Heidelberg Hosp & Clins, Univ Heidelberg J5, Univ Heidelberg Klinikujm, Univ Heidelberg Klinikum, Univ Heidelberg Mannheim, Univ Heidelberg Miriam Roehrig, Univ Heidelberg Neuebheimer Feld, Univ Heidelberg ZMBH, Univ Heidelburg, Univ Heilderberg, Univ Hosp Heidelberg, Univ Hosp Heidelberg Mannheim, Univ Klin Heidelberg, Univ Klin Heidelburg, Univ Klinikum Heidelberg, Univ Klinikum Heidelbert, Univ Klinikum Heidelburg, Univ Klinikum Heiderlberg

    • Author names

      • Is ROTHWELL N different from ROTHWELL NJ?

      • LEE S returns 14,022 publications; SUZUKI T (21,462)


Artifacts contd common objections to citation counts
…ARTIFACTS contd. OF DATACOMMON OBJECTIONS TO CITATION COUNTS

  • Negative citations

  • Over citations

    • Reviews

    • Methods

  • Self-citation and citation circles


Five compare like with like

Impact Factor OF DATA

FIVE: COMPARE LIKE WITH LIKE


Five compare like with like1
FIVE: COMPARE LIKE WITH LIKE OF DATA

  • Different citation behaviour between categories

  • Even within the same category:

    • Age of paper

    • Age and stage of author’s career


Six use relative measures not just absolute counts
SIX: USE RELATIVE MEASURES OF DATA– NOT JUST ABSOLUTE COUNTS

  • Absolute counts

    • Total publications

    • Papers published per year on average

    • Papers published in top journals (various definitions)

    • Total citations received

  • Relative counts

    • Citations per paper compared with field average

    • Citations versus expected citations

    • Cited vs un-cited papers compared with average

    • Rank within field or peer group


Eight recognize the skewed nature of citation data
EIGHT: RECOGNIZE THE SKEWED NATURE OF CITATION DATA OF DATA

  • Citation distribution is always skewed

    • Few highly cited papers

    • Majority cited little or not at all

  • Distribution type

    • Always distorted

    • Human decision

      • E.g. Criticality


Treat citation analysis as a scientific study
TREAT CITATION ANALYSIS AS A SCIENTIFIC STUDY OF DATA

  • Are the data collected relevant to the question?

  • Are the results reasonable?

  • Follow scientific process for evaluating data

  • Apply scientific skepticism


ad