ELECTRONIC ASSESSMENT HANDLING #216615 - TURNITIN VS. SAFEASSIGN COMPARISON ANALYSIS - GRIFFITH UNIVERSITY

Page created by Nicholas Jennings
 
CONTINUE READING
Comparison Analysis

                      Electronic Assessment Handling
                                            #216615
       TurnItIn Vs. SafeAssign Comparison Analysis

Prepared by:          Kerry Young - Change, Training & Communication Manager
Last modified:        20 November 2013
Version               4.0

Electronic Assessment Handling #216615                                                     Page 1
Comparison Analysis

Contents

Contents .................................................................................................................................................. 2
1.     Introduction .................................................................................................................................... 3
     1.1.      Purpose of this document ....................................................................................................... 3
     1.2.      Project Background ................................................................................................................. 3
     1.3.      Summary of Key Differences ................................................................................................... 3
2.     TurnItIn............................................................................................................................................ 4
3.     SafeAssign ....................................................................................................................................... 4
4.     TurnItIn Vs. SafeAssign.................................................................................................................... 5
     4.1.      General Comparisons .............................................................................................................. 5
     4.2.      Instructor Workflow Comparison ........................................................................................... 7
     4.3.      Student Workflow Comparison............................................................................................... 9
     4.4.      Instructor Marking & Providing Feedback ............................................................................ 10
     4.5.      Students Receiving Feedback................................................................................................ 10
     4.6.      Reporting Capability.............................................................................................................. 11

                                                                        *****

Electronic Assessment Handling #216615                                                                                                               Page 2
Comparison Analysis

1. Introduction

1.1. Purpose of this document
The purpose of this document is to assess the benefits and opportunities offered by TurnItIn (TII) as compared
with SafeAssign (SA).

1.2. Project Background
This project was formed to address the immediate business requirements of:
      Providing an efficient online assessment system as directed by the Griffith Online initiative and the
         Griffith 2020 IT Strategic Directions paper endorsed by the University Executive Group in October
         2012 which promotes “digital as the preferred method for information sharing – reducing the need to
         use and manage paper”.
      Enhancing the student experience through digital management of assessment. Increasingly, students
         have expressed dissatisfaction with both the time taken to mark assessment items and dissemination
         of assessment results.
      Improving academic integrity processes through the removal of dual submission.
      Introducing the potential for faster turnaround times for assignment marking and feedback through
         an integrated electronic marking system that includes originality checking, electronic marking and
         return.
      Promoting sustainability by reducing the environmental impact of printing, handling, storage,
         transport and disposal of paper-based assignments.

The aim of this project is to deliver a solution that enhances the student experience through end-to-end digital
management of assessment.

1.3. Summary of Key Differences
The following table provides a brief summary of the key differences between TurnItIn and SafeAssign.

     FEATURES                            TURNITIN (TII)                           SAFEASSIGN (SA)

SOURCES USED FOR              300+ million student papers               Student volunteers to add to Global
TEXT COMPARISON                                                           Reference Database
                              24+ billion web pages                     Actual numbers not publicly available
                              90,000 journals, periodicals & books      1,100 publication titles & 2.6 million
                                                                          articles

     PEERMARK              Available                                    Not available
                          NOTE: Not in our current version – plans
                          to include in the future
 ONLINE MARKING               GradeMark – allows paperless online       No online marking functionality
                               marking of submissions
      RUBRICS                 3 rubric styles available                 No rubrics available

                                                                      NOTE: BlackBoard rubrics can be
                                                                      attached.

     PAPER                    GradeMark allows the instructor to        No paper annotation functionality
   ANNOTATION                  add comments, add the grade &
                               apply rubrics online

Electronic Assessment Handling #216615                                                                       Page 3
Comparison Analysis

  FILE SIZE LIMITS            20MB with a minimum of 20 words              10MB with maximum of 5,000
                               of text                                       sentences

ALLOW SUBMISSION              Yes                                          Yes
 AFTER DUE DATE               Late submissions clearly highlighted         Submissions can be sorted via
                               in red text in TII submission inbox           sNumber or Name

                          NOTE: Answering “No” to “Enable late           NOTE: Assignment submission points can
                          submissions” during set up will prevent        be available continuously or Adaptive
                          late submissions. Adaptive Release can         Release can be used to enable or prevent
                          also be used to enable submission point        late submissions.
                          visibility to specific students as required.

  DIGITAL RECEIPT             Email notification that provides             No email notification available
                               printable page with paper ID & page
                               1 of document
  MARK VISIBILITY             TII is fully integrated with L@G             Marks need to be manually added to
                               MarkCentre                                    MarkCentre
                              Marks can be viewed in MarkCentre
                               & in the TII inbox
  MARKED PAPER                Students can access their marked             No ability to distribute a marked
   DISTIBUTION                 paper & can download as a PDF, with           paper as there is no online marking.
                               all marking & feedback visible on the
                               document.

2. TurnItIn
TurnItIn improves the student writing cycle by preventing plagiarism and providing rich feedback to students.
It comprises:
       OriginalityCheck – ensures original work by checking submitted papers against 24+ billion web pages,
          300+ million student papers and leading library databases and publications.
       GradeMark – saves time and improves feedback through online grading where standard and
          customised marks appear directly on the student’s paper.
       PeerMark – Engages students in the writing process by providing structured, anonymous feedback of
          other student’s written work.
It’s used by more than 10,000 institutions in 126 countries to manage the submission, tracking and evaluation
of student papers online.

NOTE: Griffith University’s current version of TurnItIn does not support PeerMark.

3. SafeAssign
SafeAssign is a tool used to prevent plagiarism and to create opportunities to help students identify how to
properly attribute sources rather than paraphrase. It compares submitted assignments against a set of sources
to identify areas of overlap between the submitted assignment and existing works and is effective as both a
deterrent and an educational tool. It’s based on a text-matching algorithm that analyses submission text
against multiple data sources including:
      Institutional document archives – contains all papers submitted to SafeAssign by users in their
         respective institutions.

Electronic Assessment Handling #216615                                                                         Page 4
Comparison Analysis

        Global reference database – contains over 15 million papers volunteered by students from BlackBoard
         client institutions to help prevent cross-institutional plagiarism.
        ProQuest AB/Inform database – more than 1,100 publication titles and about 2.6 million articles from
         1990s to present time, updated weekly.
        Internet – searches across the broader internet for matching text using the Yahoo! BOSS search
         service as the underlying internet index provider.

4. TurnItIn Vs. SafeAssign
The following comparison tables have been generated from the University of Queensland’s elearning website
page: http://www.elearning.uq.edu.au/content/turnitin-vs-safeassign

NOTE: University of Queensland were considering the potential loss/gain of functionality moving from TurnItIn
to SafeAssign and were using the basic version of TurnItIn. Griffith University is considering the potential
loss/gain of functionality moving from SafeAssign to TurnItIn and is using the direct plugin version of TurnItIn.
This differing focus has been reflected in the comparison tables below.

4.1. General Comparisons
  FEATURES                 TURNITIN (TII)              SAFEASSIGN (SA)                    COMMENTS
 LICENCE FEE        Annual licence fee.           Included in Blackboard        TurnItIn licence requires
    COST                                          licence (no extra cost).      additional expenditure & is
                                                                                comparatively expensive to the
                                                                                overall cost of Blackboard.
   STUDENT          Currently checks against      When a student submits a      Actual numbers not publicly
    PAPERS          300+ million student          SafeAssignment, their file    provided for SA, but TII
    CHECKS          papers (as at Aug 2013),      will be added to the          numbers have previously been
                    Instructors select the        institutional database        much higher due to wider
                    repository that is used, or   unless the SafeAssignment     usage.
                    if no repository is used.     is a ‘draft’ (The student     NOTE: GU SA database
                                                  also has the option of        comprises approx. 5-6 years of
                                                  submitting the file to the    assessment. Currently not
                                                  Global Reference              possible to bulk import these
                                                  Database, but this is         directly into TII. They can be
                                                  entirely voluntary).          individually uploaded;
                                                                                cost/time benefit analysis
                                                                                required.
   INTERNET         Currently checks against      Internet - comprehensive      Actual numbers not publicly
    CHECKS          24+ billion web pages         index of documents            provided for SA, but TII
                    indexed (as at Aug 2013).     available for public access   numbers have previously been
                                                  on the Internet including     much higher due to wider
                                                  Google Scholar.               usage.
   ONLINE           Currently checks against      ProQuest ABI/Inform           Possibly equivalent.
 JOURNALS,          90,000+ journals,             database with over 1,100
 DATABASES          periodicals & books (as at    publication titles and
   CHECKS           Aug 2011).                    about 2.6 million articles
                                                  from '90s to present time,
                                                  updated weekly (exclusive
                                                  access).
  COPIES OF         Submission to the             Global Reference Database     TII enables instructors to select
  STUDENT           repository (or not) is        containing papers that        repository submission while SA
 PAPERS KEPT        configured by the             were volunteered by           is a student opt-in process.
                    instructor when the           students from Blackboard

Electronic Assessment Handling #216615                                                                       Page 5
Comparison Analysis

                    assignment submission         client institutions to help
                    point is set up.              prevent cross-institutional
                                                  plagiarism.

   PAPERS           All assignments created in    Institutional document        As TII is reliant on instructor
SUBMITTED TO        TII since it was introduced   archives containing all       configuration, clear guidance
     GU             at GU have been added to      papers submitted to SA by     (policy & process) will need to
                    the archives if configured    users in their respective     be provided to ensure
                    that way by the instructor.   institutions. GU currently    consistency.
                                                  has 5-6 years of
                                                  assessment.

  TIME FOR          Produces OriginalityCheck     Between 30 seconds to a       Equivalent functionality.
 ORIGINALITY        in a couple of minutes.       couple of minutes.
REPORT TO BE        Subsequent reports may        NOTE: This is load
 GENERATED          take up to 24 hours to        dependent and at times
                    generate to avoid             may take up to 24 hours to
                    matching with the             generate.
                    previous submission.
  PEERMARK          PeerMark: allows Peer-        Not available.                Functionality gain if included in
                    marking function                                            our future Direct Plugin version.
                    NOTE: Not currently
                    available in our BlackBoard
                    Direct Plugin version,
                    however there are plans to
                    include PeerMark in the
                    future.
   ONLINE           GradeMark – common            No online marking             Most obvious gain of
  MARKING           comments and saveable         functionality.                functionality that may assist in
                    comments in drag and                                        the effective roll-out of Griffith
                    drop style - allowing for                                   Online initiative.
                    paperless online marking
                    of submissions.
                    NOTE: Half marks (0.5)
                    unavailable.
   RUBRICS          3 styles of rubrics           No rubrics available.         Limitations with TII rubric
                    (Standard, Custom &                                         functionality may affect
                    Qualitative) that can be      NOTE: BlackBoard Rubrics      widespread adoption.
                    saved, edited, shared and     can be attached.              NOTE: GBS maintains ALEC, a
                    applied.                                                    purpose-built web application
                                                                                tool that incorporates generic
                                                                                & customised rubrics, so TII
                                                                                may not address their specific
                                                                                requirements.
   SUPPORT          Online support ticketing      Online support ticketing      Australian-based TII support
                    system. Currently             system with Blackboard        centre would assist in rapid
                    establishing service level    support.                      support response.
                    agreement to address this
                    & TII has confirmed there
                    will be an Australian-based
                    support centre in early
                    2014.

Electronic Assessment Handling #216615                                                                        Page 6
Comparison Analysis

 UPLOADING          Instructors can upload on       Instructors may upload          Equivalent functionality.
ON BEHALF OF        behalf of students, and         papers directly with the
  STUDENTS          can submit for unenrolled       DirectSubmit feature,
                    students.                       without student
                                                    involvement.
INTEGRATION         Integrated with                 Integrated with                 Equivalent functionality.
    WITH            BlackBoard MarkCentre.          BlackBoard MarkCentre.
MARKCENTRE
BLACKBOARD          Assignments can be added        Assignments appear in           Equivalent functionality.
INTEGRATION         to any content area in          courses as a new content
                    BlackBoard.                     type and can be added to
                                                    any course content area.
   FILE SIZE        Overall file size allowed is    Overall file size allowed is    Increased file size with TII.
    LIMITS          20MB. Must contain at           10MB. Maximum of 5000
                    least 20 words of text.         sentences.
   URL LINK         Originality Reports             Direct URL to report that
                    available in 4 formats          can be emailed to others.
                    within system (Match
                    Overview, All Sources,
                    Match Breakdown &
                    Direct Source
                    Comparison).
  STUDENTS          Yes - determined by             Yes, if instructors enable      Comparable functionality.
VIEW REPORTS        instructor settings             student viewing, each
                                                    student can view the
                                                    reports for their own
                                                    submitted papers.

4.2. Instructor Workflow Comparison
  FEATURES                TURNITIN (TII)               SAFEASSIGN (SA)                        COMMENTS
ADD FILE TO         Not currently available.       Unable to attach file for       Neither option currently provides
     AN             This feature will be added     students to SA, however         the option for instructor to add a
ASSIGNMENT          in future releases.            these files can be added        file to the assignment, e.g. cover
                                                   in the content area.            sheets, examples, marking criteria
                                                   NOTE: Can add a file with       sheets etc. TII has announced
                                                   BlackBoard Assignment           that this feature will be added in
                                                   tool.                           the future.
INSTRUCTORS         Through TII direct plugin      Through SA tool in control      Comparable functionality.
    VIEW            which takes you to the         panel where you have
ASSIGNMENTS         TurnItIn inbox. Can also       two options either to
                    view through MarkCentre.       view/ edit assignments in
                                                   the course, or manage
                                                   and upload papers to the
                                                   service. Can also view
                                                   through MarkCentre.
  ALLOW             Yes, late submissions          Yes, submissions can be         Potential policy considerations if
SUBMISSION          clearly highlighted in red     sorted via sNumber or           late submission is enabled.
 AFTER DUE          text in TII submission         Name.
   DATE
                    inbox. NOTE: Answering
                    “No” to “Enable late           NOTE: Assignment
                    submissions” during set        submission points can be
                                                   available continuously, or

Electronic Assessment Handling #216615                                                                              Page 7
Comparison Analysis

                    up will prevent late           Adaptive Release can be
                    submissions. Adaptive          used to enable or prevent
                    Release can also be used       late submissions.
                    to enable submission
                    point visibility to specific
                    students as required.

INSTRUCTORS         Through the content area       Through the control
 ADD PAPERS         where the students             panel. One file
                    access, or through the         only. Option to choose
                    control panel – inbox.         whether or not to add to
                                                   institutional search
                    Upload one file only per       database. Option to copy
                    student                        and paste assignment
                                                   instead of upload.
                    Can add paper for
                    enrolled or unenrolled         Does not appear to allow
                    student.                       an instructor to upload on
                                                   behalf of a student.
                    Copy and paste option.
                                                   Paper ID. No submission
                    Provision of paper ID and      receipt provided.
                    submission receipts
 ACCEPTABLE         MS Word, WordPerfect,          .zip, .doc, .docx, .odt, .txt,   Neither system currently allows
FILE FORMATS        PostScript, PDF, HTML,         .pdf, .rtf and .html             PowerPoint.
                    RTF, ODT and plain text.                                        NOTE: TII to enable PowerPoint &
                                                                                    Excel in future release.
   INBOX            Go to course tools,            Go to course tools,              TII provides more functionality.
OPTIONS FOR         TurnItIn assignments –         SafeAssign – click on the
INSTRUCTORS         click view.                    SafeAssignment link. Use
                                                   drop down box to select
                    Open file – either original    view submissions.
                    or in document viewer
                                                   Can open or save files
                    Can export inbox as            individually
                    spreadsheet
                                                   Can delete attempts &
                    Can delete attempts &          view report percentage of
                    view report percentages        all submitted papers
                    of all submitted papers
 DOWNLOAD           Download (bulk or              Download not available           TII provides more functionality via
   PAPER -          individual) is available via   from MarkCentre column.          submission inbox.
INSTRUCTORS         the TII submission inbox.      Download all papers in a
                    Download of individual         batch (cannot select
                    assignments are also           specific papers to include
                    available via MarkCentre       in the batch file), or
                    column.                        individual papers.
                                                   NOTE: Individual papers
                                                   can be accessed through
                                                   MarkCentre.
  EXCLUDE           An instructor has the          Can select/deselect              TII function to exclude references
REFERENCES &        option to exclude quoted       sources and then re-run          & text when viewing the
    TEXT            and/or bibliography from       the report.                      OriginalityCheck is simpler to use.

Electronic Assessment Handling #216615                                                                            Page 8
Comparison Analysis

                    the OriginalityCheck when
                    configuring the
                    submission point or when
                    viewing the
                    OriginalityCheck.

4.3. Student Workflow Comparison
  FEATURES                 TURNITIN (TII)                SAFEASSIGN (SA)                     COMMENTS
   STUDENT          Access through content          Access through content         While the TII process is three
    SUBMIT          area, click on link. Three      area. Click on link, as with   steps, it seems to provide
    PAPERS          step process, one is            TurnItIn. Can attach file,     students with more clarity
                    upload, two is confirm and      tells student about file       about the process & includes
                    submit, three is                types. No info about file      the provision of a digital receipt.
                    confirmation with digital       size or image size
                    receipt.                        provided. Images must
                                                    not exceed 2MB or the
                    Can attach one file             submission may fail.
                    only. Informs students of
                    file types and file sizes.
  AGREE TO          In submitting this work I       By submitting this paper,      Comparable functionality.
   SUBMIT           confirm that this               you agree: (1) to the
                    submission is my own            Terms of Use at SafeAssign
                    work and I accept all           Terms of Use; (2) that your
                    responsibility for any          institution may use your
                    copyright infringement          paper in accordance with
                    that may occur as a result      your institution's policies;
                    of this submission.             and (3) that your use of
                                                    SafeAssign will be without
                                                    recourse against
                                                    Blackboard Inc. and its
                                                    affiliates.
   DIGITAL          “Your submission was            SafeAssignment                 TII provides more assurance to
   RECEIPT          successful” appears in          successfully submitted for     students of successful upload
                    green banner. Email             assignment "test safe          via provision of digital receipt.
                    notification also received      assignment" appears in
                    that provides printable         green banner like any
                    page, with paper ID, and        other “success”
                    page 1 of the document.         notification in
                                                    BlackBoard. No email
                                                    notification provided.
 ASSIGNMENT         Students can view               Student can click on the       Comparable functionality.
INFORMATION         assignment information,         view/complete link in the
 VIEWABLE BY        including date & time           content area, and see the
   STUDENT          submitted, can open &           assignment information,
    AFTER           download submitted              including date and time
 SUBMISSION         document, view matching         submitted, text of
                    report percentage/report        submitted doc, can
                    (if that functionality set by   download original doc,
                    instructor). Can also view      view matching report
                    grade if GradeMark is used      number/report (if that
                    and date set.                   functionality set by

Electronic Assessment Handling #216615                                                                          Page 9
Comparison Analysis

                                                    instructor). Can also view
                                                    any instructor comments,
                                                    attached files and grade
                                                    when graded via
                                                    GradeCentre.

4.4. Instructor Marking & Providing Feedback
     FEATURES                      TURNITIN (TII)                  SAFEASSIGN (SA)                 COMMENTS
 ‘OPEN ATTEMPT’          Doesn’t display student name       Displays student name. Can         Comparable
  OPTION FROM            in this screen. Can clear          add comments to students;          functionality.
    WITHIN THE           attempt, open paper and            attach file, change grade,
   MARKCENTRE            originality report, add or         open file and report, and see
   “VIEW GRADE           change grade, add feedback to      percentage matching
     DETAILS”            students, attach multiple files,   result. Can clear attempt
                         and add instructor notes and       from that screen as well.
                         attach multiple files.             NOTE: Marking notes can be
                                                            added if teaching staff choose
                                                            to add them via “Override
                                                            Mark” screen. This is separate
                                                            to the “Mark Attempt”
                                                            screen.
ONLINE MARKING           GradeMark using QuickMarks,        No online marking facilities.      Most obvious gain
                         add and save comments, use                                            of functionality that
                         rubrics – marking                                                     may assist in the
                         guide. Online marking                                                 effective roll-out of
                         capability and integration with                                       Griffith Online
                         MarkCentre.                                                           initiative.

     MAKING              Originality reports are made       Originality reports are made       Comparable
   ORIGINALITY           available to students based on     available to students based        functionality.
     REPORTS             settings the instructor sets up    on settings the instructor sets
  AVAILABLE TO           when creating the assignment.      up when creating the
    STUDENTS             Students can view and              assignment. Students can
                         download papers from the           view and download papers
                         content area in which the          from the content area in
                         assignment is set up.              which the assignment is set
                                                            up.

4.5. Students Receiving Feedback
     FEATURES                      TURNITIN (TII)                 SAFEASSIGN (SA)                 COMMENTS
 MARK VISIBILITY          Marks can be seen in my           Mark is manually entered          Clear guidance to
                          grades, and in the TurnItIn       into MarkCentre.                  academics required to
                          inbox. The post date will have                                      ensure accidental
                          an impact on when marks and                                         mark visibility does
                          feedback in TII are released to                                     not occur.
                          students. If academics don’t
                          want these visible
                          immediately, there may be
                          some confusion between

Electronic Assessment Handling #216615                                                                          Page 10
Comparison Analysis

                          Reveal marks & Post dates
                          settings. E.g. they may hide
                          the column in MarkCentre,
                          but inadvertently make the
                          mark visible to students
                          within the TII inbox.
     PAPER                The GradeMark functionality        There is no paper               The online marking
   ANNOTATION             allows the instructor to add       annotation functionality in     functionality of TII is
                          comments, add the grade,           SA.                             superior.
                          apply rubrics (marking guide)
                          completely online
  MARKED PAPER            Students can access their          No ability to distribute a      The TII distribution
  DISTRIBUTION            marked paper & can                 marked paper (because           process is superior.
                          download as a PDF, with all        there is no online marking).
                          marking and feedback visible       Instructors can attach a
                          on the document. They can          document to the
                          also choose to download the        MarkCentre feedback area,
                          originally submitted               so a printed, marked,
                          document, in its original          tracked changes and/or
                          format.                            scanned document could be
                                                             uploaded and added.

                                                             Otherwise, instructors could
                                                             download all submissions
                                                             once they are all received,
                                                             print, mark and distribute as
                                                             normal.

4.6. Reporting Capability
     FEATURES                      TURNITIN (TII)                 SAFEASSIGN (SA)                 COMMENTS
  OVERALL CLASS           Data can be obtained from          Marks data can be extracted     TII provides more
  PERFORMANCE             TurnItIn Web interface             from MarkCentre                 functionality.
                          including: all assignments,
                          individual assignments etc.
                          Ability to download all marks
                          in Excel via TurnItIn summary
                          page in direct plugin.
                          NOTE: Enhanced reporting
                          capability is also available via
                          Turnitin.com (requires
                          creation of an account to
                          access).
    SIMILARITY            Data can be obtained from          Text matching scores            TII provides more
INDEX/ORIGINALITY         TurnItIn Web interface or          available within the SA         functionality.
 REPORT STATISTICS        integration tool.                  interface. They can only be
                          NOTE: Ability to download all      extracted via cut and paste.
                          marks in Excel which provides
                          text matching percentage
                          scores.

Electronic Assessment Handling #216615                                                                         Page 11
You can also read