Machine Vision for Cultural Heritage & Natural Science Collections
Data Ethics • Deep Learning • Perceptual Hashing • Convolutional Neural Networks • Semantic Segmentation • International Image Interoperability Framework • Neural Style Transfer • Data Science • Generative Adversarial Networks • Visualization • Variational Autoencoders • Manifold Learning • Transfer Learning • Computer-Assisted Curation • Computer Vision • Automated Captioning • Dimensionality Reduction • Culturally-Sensitive Data
Overview
The mass digitization of visual collections, on the order of hundreds of thousands or millions of images, creates new challenges for curators and researchers alike. Simultaneously, the rapid pace of industry innovation in deep learning (from guiding self-driving cars to captioning smartphone images) demands the attention of library, museum, and academic professionals.
Existing practices of cataloging and description can be augmented by recent advancements in machine vision, and human expertise can likewise guide the development of future algorithms for the humanities and sciences alike. To showcase work that’s underway and explore potential collaborations, the Yale-Smithsonian Partnership held a one-day symposium on the topic of machine learning for cultural heritage and natural science collections. The event brought together scholars and curators from both institutions for conversations, demonstrations, and future partnerships.
Keynote Speakers
- Rebecca Dikow (Data Science Lab, Smithsonian Institution)
- Holly Rushmeier (Computer Science, Yale)
Logistics
- Date: April 26, 2019
- Time: 10:00 a.m. – 4:00 p.m.
- Location: Franke Family Digital Humanities Laboratory, Sterling Memorial Library, 120 High Street, New Haven, CT
Schedule
Start | End | Name | Title |
---|---|---|---|
9:30am | 10:00am | Registration & Coffee | |
10:00am | 10:05am | Peter Leonard | Welcome |
10:05am | 10:35am | Rebecca Dikow (Data Science Lab, Smithsonian Institution) | Data-Intensive Approaches to Digitized Museum Collections |
10:35am | 11:05am | Holly Rushmeier (Computer Science, Yale) | Collecting Useful Data |
11:05am | 11:25am | Peter Leonard | Visual Culture Computation at the Yale DHLab |
11:25am | 11:45am | Douglas Duhaime (DHLab, Yale) | Computer Vision and Early Copyright History |
11:45am | 1:15pm | Lunch | |
1:15pm | 1:35pm | Alex White (NMNH & Data Science Lab, Smithsonian Insitution) | Deep Learning, Biogeography, and the Evolution of Plant Shapes |
1:35pm | 1:45pm | Catherine DeRose (DHLab, Yale) | Neural Style Transfer |
1:45pm | 1:55pm | Adam Metallo (Digitization Program Office, SI) | Collaboration and Impact |
1:55pm | 2:15pm | Stephen Krewson (English, Yale) | Mining the Medical Heritage Library |
2:15pm | 2:25pm | Break | |
2:25pm | 2:55pm | Jacob Kim (Hirshhorn, Smithsonian Institution) and Dan Michaelson (School of Art, Yale) | Hirshhorn Eye: Activating Artworks using Machine Vision |
2:55pm | 3:25pm | Discussion and Next Steps: Ideas for Collaboration | |
3:25pm | 3:30pm | Susan Gibbons (University Librarian & Deputy Provost, Yale) | Closing Remarks |