When   I   tried   out   the   Cinemetrics   software   on   the   first   12   minutes   of   The   World   of   Suzie   Wong,   I   straightaway   put   in   an   extra   couple   of   key   presses   through   trigger-happiness.   But   more   importantly,   I   was   aware   that   on   a   couple   of   occasions   my   response   was   delayed,   because   my   attention   had   been   momentarily   seized   by   what   was   going   on   across   the   cut,   from   the   point   of   view   of   film   editing   technique. 
This   raises   an   important   point   about   the   use   of   the   Cinemetrics   recording   software.   It   is   founded   on   the   assumption   that   each   user’s   reaction   time   is   constant,   to   within   0.1   second. 
Reaction   time   has   been   one   of   the   most   extensively   studied   variables   in   experimental   psychology   since   it   was   introduced   in   1862   by   Wundt.   The   simplest   form   of   test   is   for   the   subject   to   be   presented   with   a   series   of   flashes   of   light   at   random   intervals,   to   which   he   is   asked   to   respond   by   pressing   a   button   as   quickly   as   possible.   Vast   numbers   of   experiments   show   that   the   mean   value   of   reaction   time 
It   does   not   matter   for   the   purposes   of   Cinemetrics   if   your   mean   reaction   time   is   longer   or   shorter   than   another   person’s   reaction   time,   but   it   does   matter   if   it   is   not   constant   to   within   0.1   second. 
With   this   in   mind   I   have   checked   the   recorded   Cinemetric   results   for   three   films   against   my   frame-accurate   measurements.   The   films   analysed   were   la   Signora   senza   camelie,   posted   by   Yuri   Tsivian,   Verboten!,   posted   by   John   C.,   and   Shadows,   posted   by   Charley   Leary.   For   the   first   of   these   I   used   a   rather   worn   16   mm.   print,   which   may   have   some   frames   missing   at   the   reel   changes,   and   made   the   measurements   on   a   
The   comparison   of   the   sets   of   results   is   not   as   simple   as   it   might   seem   at   first   glance,   for   a   number   of   reasons,   First   of   all,   not   everyone   starts   and   ends   their   counts   at   the   same   place.   My   standard   procedure   for   the   last   thirty   years   has   always   been   to   start   the   count   immediately   after   the   last   credit   in   the   main   title   sequence   (usually   the   director   credit),   and   stop   immediately   at   the 
It   is   not   of   course   possible   to   determine   the   mean   reaction   time   for   each   recorder   from   their   results,   but   one   can   get   the   errors   they   made   in   the   measurement   of   the   shot   lengths. 
To   give   a   flavour   of   this,   I   quote   the   differences   between   my   results   and   those   of   Yuri   Tsivian   for   the   whole   102   shots   under   consideration   in   la   Signora   senza   camelie: 
0   0   0.1   0.1   0   0.8   1.2   -0.2   -1.7   1.7   0.4   -0   0.2   -0.2   0.2   0.2   -0.1   0   -0.2   0.4   -0.1   0.1   -0.4   0.4   0   -0.7   0.6   0   0   0.2   0.3   0.2   1.7   0.1   0   0.2   -0.3   0.3   -.10   0.2   0   0.4   -0.2   0.2   0   0   0   0   -0.7   -0.4   -0.2   0.1   -0.1   -0.2   0.4   0   0   -0.9   0.6   0   0   0   -0.2   0.6   0   -0.2   1.3   0.4   -0.2   0   -0.1   0   -0.1   -0.2 
To   get   a   better   sense   of   this   it   is   best   to   show   the   distribution   of   these   errors   in   a   graph: 
Loading...
One   would   expect   the   measurement   errors   to   be   normally   distributed,   and   indeed   the   above   shows   a   very   rough   approximation   to   a   Normal   (or   Gaussian)   distribution.   If   there   were   no   errors   greater   than   0.1   second,   then   there   would   be   just   be   a   single   very   tall   bar   straddling   the   zero   point   in   the   above   graph,   and   nothing   else.   An   important   variable   describing   error   distributions   are   their   Standard   Deviations,   which   is   0.70   in 
The   other   two   films   studied   have   a   larger,   and   more   usual,   number   of   shots   in   them,   so   I   will   just   illustrate   the   error   graphs   for   them,   starting   with   Verboten! 
Loading...
The   Standard   Deviation   for   the   errors   about   the   correct   values   of   the   shots   lengths   in   this   case   is   1.06,   which   is   larger   than   the   previous   example. 
For   Shadows,   the   results   are   a   lot   better. 
Loading...
In   this   case   the   Standard   Deviation   is   0.54,   and   the   error   distribution   is   much   more   like   a   Normal   distribution. 
The   general   indications   are   that   as   long   as   the   Cinemetrics   shot   length   recording   system   is   used,   as   it   is   at   the   moment,   for   getting   general   indications   of   cutting   rates   throughout   a   movie,   then   it   is   satisfactory.   But   even   with   the   most   accurate   Cinemetrics   recording   so   far   found   by   me,   which   is   for   Shadows,   the   errors   are   still   of   a   size   which   could   make   the   results   noticeably   unreliable   if   they   occurred   
The   alternative   method   that   I   have   used   to   get   the   frame-accurate   results   for   this   study   does   take   longer,   but   in   the   case   of   Verboten!   and   Shadows,   it   only   took   me   about   three   hours   to   mark   the   cuts   on   each   film. 
I   think   it   would   be   very   helpful   if   in   future,   as   already   has   been   mooted,   the   people   using   Cinemetrics   would   note   whether   the   source   they   have   used   is   PAL   or   NTSC,   or   if   the   Cinemetrics   recording   was   done   during   the   projection   of   an   actual   film.   And   an   indication   of   the   start   and   end   points   of   the   Cinemetrics   recording   would   be   helpful   as   well. 
Barry   Salt, 
January   2008