Community Media Archive

Community Media Archive
- Vision
  - a collection of broadcast quality, locally produced, shows with sufficient descriptive metadata from Community Media Centers that can be freely shared.
  - Archive as the hub of a sharing/distribution system
- Scope of Internet Archive
  - nonprofit digital library started in 1996
  - 7+ million items (books, videos, audio, live music)
  - 280+ billion web pages in the "Wayback Machne"
  - aim is "Universal Access to All Knowledge"
  - Documentary about Internet Archive
- Scope of Community Media Archive
  - 24,000+ videos
  - 31 access centers
  - 1.3 million downloads
  - 35TB of storage
- Related Collections
  - Access Centers with collections that aren't a subcollection of the CMA (CMAP, CTN5)
  - Tedtalks - 1,354 videos w ACM compliant MPEG2 versions
  - Poptech - 224 videos w ACM compliant MPEG2 versions
  - NASA Kids videos (NASA Connect, NASA Destination Tommorrow, NASA SciFiles - 61 episodes, 37 hours) in opensource_movies collection
  - Access Centers without their own collection (Grand Rapids and Akaku: Maui)
- Community Media Archive on the Roku
  - to add the private channel with the Community Media Archive to the Roku go to: https://owner.roku.com/add/NMJS5
  - Screenshots of CMA on the Roku
- Getting Started
  - Conceptual
    - collection, item, file
    - "details" page - item level
    - metadata - item level
    - getting organized more important than technical knowledge
  - Procedural
    - register an email address
    - email the collections group for a new collection
    - request it as a subcollection of the "community_media" collection
    - include a descriptive text blurb about the collection
    - include a graphic for the collection
    - indicate the registered email addresses that can administer the collection
    - input formats they accept and what output formats they derive
  - to upload
    - Use manual interface to upload first several videos
      - http://archive.org/upload
    - Bulk uploader available - uses a Comma Separated Value file for metadata
      - https://github.com/kngenie/ias3upload
- Metadata and the Archive Discussion
  - minimal required - identifier, "creator", title, description, mediatype
  - anything accepted (and retrievable through meta.xml file stored on item's detail page)
  - subject(s) - what shows up under "Browse by subject/keyword" link for collection
  - identifier must be unique across all 7+ million items stored at I/A
  - file naming restrictions A-Z0-9._- no spaces, parenthesis, brackets pound signs allowed in file names
    - playback server is likely more permissive than archive.org
    - suffix matters if you want the animated gifs to show up for your files
  - fields added by I/A - uploader, addeddate, publicdate, parent collections
  - extra fields are searchable but not returned in search results
    - "series" and "sequence" or "episode" tags
    - "presenter" tag
  - "overload" subject keywords
    - year
    - series
- Internet Archive Admin Interface
  - What's happening inside the archive with my item?
  - Every item has a history and it's kept forever
    - http://catalogd.us.archive.org/log_show.php?task_id=
    - that's good!
    - runtime and audio/video parameters from ffmpeg output available for every file transcoded
  - "Edit Item"
    - useful for adding/correction metada on a singe item
  - "Item Manager"
    - "make dark" function
    - force "re-derive" of certain formats
  - "Item History"
    - links to all prior logs for the item
  - Advanced Search
    - fielded, boolean search (*not* Google style!)
    - CSV, HTML, JSON or RSS output
  - Metadata XML & JSON files
  - Metadata cleanup after the fact
    - "Edit Item" useful for single items
    - bulk uploader program is available via https://github.com/kngenie/ias3upload
      - accepts metadata in Comma Separated Value format, certain required fields
      - can be used for bulk metadata adds/updates without uploading files
  - RSS feeds
- Finding Programs for Re-Broadcast
  - Advanced Search "AND format:MPEG2" search qualifier
  - TedTalks & PopTech collections
  - archive.org RSS feeds not good enough by themselves
    - lack runtime information
    - keywords are hidden in the RSS feed
      - technically correct accrding to MRSS 2.0 spec but no one seems to implement it
- Downloading Programs for Broadcast
  - grab the MPEG2 version!
  - grab the metadata XML file or "screen scrape" title, description, runtime
  - grab the files.xml file; runtime (in seconds) length available from "length" element of _files.xml for an item
  - want to automatically download new episodes in the series?
    - subscribe to the RSS feed for the collection or create one from "advanced search"
  - or grab the _archive.torrent file
- Community Media Archive Updates
  - MPEG2 transcoding profile is available https://github.com/traceypooh/deriver-archive
  - bulk uploader program is available via https://github.com/kngenie/ias3upload
  - new collections available w ACM compliant MPEG2 letterboxed video - tedtalks, poptech
    - TedTalks index available to help programming decisions
  - Access Humboldt is offering an upload service
- Somerville Case Study
  - Director had attended last year's presentation
  - 1,500 video tapes
  - used interns to organize and transcode the collection
  - Filemaker database dumped to spreadsheet
  - Videos digitzed to MPEG4 format from tape
  - First batch of 405 files - 630GB of files
  - Shipped hard drive via UPS
  - spreadsheet modified for input into the bulk loader program
- Gift Cultures
  - http://www.catb.org/esr/writings/homesteading/homesteading/ar01s06.html
  - reputation is based on what you give away
  - imagine public access as a gift culture!
  - what will you contribute?