{"id":38,"date":"2018-03-29T14:08:05","date_gmt":"2018-03-29T18:08:05","guid":{"rendered":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/?post_type=chapter&#038;p=38"},"modified":"2019-06-12T12:03:58","modified_gmt":"2019-06-12T16:03:58","slug":"step-4-provide-clear-expectations","status":"publish","type":"chapter","link":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-4-provide-clear-expectations\/","title":{"raw":"Step 4: Provide clear expectations","rendered":"Step 4: Provide clear expectations"},"content":{"raw":"<p class=\"no-indent\"><strong>As with any assignment, students must be given clear expectations for a successful DHSS project.<\/strong> Product is important, but assessing students on <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#exlearning\"><em>process<\/em><\/a>\u00a0is even more important in a DHSS project where students may be working with concepts, tools, technologies, and materials that are different than what they are used to. Instructors must have patience with students so that students can come to understand the ways they are being pushed to do and think in new ways because of DHSS. This may involve explaining the expectations in different ways, providing <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-6-assess-accordingly\/\">clear rubrics<\/a>, and pointing students back to the course's <a href=\"https:\/\/teachingcommons.yorku.ca\/wp-content\/uploads\/2015\/02\/Learning-outcomes-worksheet.pdf\">overall learning outcomes<\/a>. Most realistically, however, the assignment will require you to do all of those things.<\/p>\r\n<p class=\"no-indent\">A traditional essay is (usually) just evaluated on the final product: the written paper. <strong>But DHSS, as it is framed in this Instructor's Guide, is based on learning through <em>experience<\/em> \u2013 <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#exlearning\">experiential learning<\/a>.<\/strong> Students' experiences \u2013 the process behind the product \u2013 need to come to the fore in evaluation and assessment. Your articulation of the assignment and assessment criteria can help students in making the shift from <em>just<\/em> product to product <em>and process<\/em>.<\/p>\r\n<p class=\"no-indent\">With clearly written assessment criteria, students learn what you want, how it fits into the course, and how it will be assessed. At the same time, however,\u00a0you should also be open to a final product that may look different than you originally expected; time, resources, and space for interpretation can morph a final DHSS product in ways you may not be able to predict at the start. This is how students will learn from the <em>experience<\/em> of creating their DHSS project. They need to know that sometimes failures and false starts are part of the process of <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-5-engage\/\">engaging<\/a> in DHSS and that your assessment has room for this exploration.<\/p>\r\n<p class=\"no-indent\">In an example of a professor needing to be clear about, and thus clarifying, her expectations for a DHSS assignment,\u00a0<a href=\"https:\/\/amandastarlinggould.com\/\">Dr. Amanda Starling Gould<\/a> taught a course at for <a href=\"https:\/\/duke.edu\/\">Duke University<\/a>\u00a0in 2013 titled \u201c<a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/\">Augmenting Realities: Technoscience, Digital Art, &amp; Electronic Literature<\/a>\u201d. The final assignment was a \u201c<a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/assignments\/\">transmedia essay,<\/a>\u201d which she described in the syllabus as \u201cthe equivalent of an 8-12 page (double-spaced) scholarly article.\u201d She explained to her students that they would \"augment\" the traditional format of an essay by inserting media, links, and the integration of a \"(Re)Mediated Element\" into their assignment. Although this \"(Re)Mediated Element\" may have been clear to Dr. Gould, <a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/evaluating-digital-humanities-projects-collaborative-course-assessment\/\">students had questions about it<\/a>\u00a0and logically asked whether they were just adding a media to a traditional essay.<\/p>\r\n<p class=\"no-indent\">Students' questions provided the opportunity for Dr. Gould to (re)explain her vision of a \"transmedia essay\" to her students and to clarify what the assignment involved. Gould explained to her students that rather than adding media to a standard essay, \"<strong>I want you to CREATE something or ANALYZE something or MAP something or REMEDIATE something<\/strong>.\u201d This new media element, she explained, \u201cshould be chosen based on its ability to do something that paper cannot do.\u201d In this way, she encouraged her students to \u201c<strong>think of your media element as an experiment that extends and\/or explores the questions you are asking in your work<\/strong>.\u201d This element of their assignment would expand students' critical exploration of the subject matter because, she argued,\u00a0\u201cpresenting data in a different format, if done thoughtfully and accompanied by a critical essay exploring what those different format presentations mean (or say, or do, or are commenting on, etc.), CAN be an argument or relevant contribution to a written work.\u201d<\/p>\r\n<p class=\"no-indent\"><strong>Articulating this shift in expectations \u2013 <\/strong>from adding media to an essay to <strong><em>creating and integrating media\u00a0<\/em><\/strong>in an essay in a way to demonstrate, develop, or prove an argument \u2013 <strong>prepared students to think about the act of <em>creation<\/em> as central to their work<\/strong>. Gould emphasized that it was not just the final \u201ctransmedia essay\u201d that students should focus on, but rather the investment in thinking about what a \u201c(Re)Mediated Element\" may, can, and will do in the service of advancing their ideas in the course. Gould also mentioned that she would bring in and show examples to the class, grounding her vision with references that she can discuss with her students.<\/p>\r\n<p class=\"no-indent\">Through these exchanges with her students, Gould identified what she wanted from a \"transmedia essay,\" explaining to students how her expectations were both similar and different to a traditional essay and how this work tied back to overall learning in the course. This is good pedagogical practice overall, as identified by <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#hunter\">Madeleine Hunter<\/a>, but is especially important because of the newness involved in a DHSS assignment.<\/p>\r\n<p class=\"no-indent\">Dr. <a href=\"https:\/\/t.co\/5ui9t54NF4\">Shannon Mattern<\/a>, Associate Professor in the School of Media Studies at The New School in New York, explored how to <a href=\"http:\/\/journalofdigitalhumanities.org\/1-4\/evaluating-multimodal-work-revisited-by-shannon-mattern\/\">evaluate assignments with multiple forms of media<\/a>, like the transmedia essay, and identified the key themes one should use to evaluate these types of students' projects. These include:<\/p>\r\n\r\n<ul>\r\n \t<li>Concept &amp; content<\/li>\r\n \t<li>Concept\/content-driven design &amp; technique<\/li>\r\n \t<li>Transparent, collaborative development, and documentation<\/li>\r\n \t<li>Academic integrity &amp; openness<\/li>\r\n \t<li>Review &amp; critique<\/li>\r\n<\/ul>\r\n<p class=\"no-indent\">Under each theme she provided a list of questions that framed her evaluation of that theme.\u00a0I encourage you to <a href=\"http:\/\/journalofdigitalhumanities.org\/1-4\/evaluating-multimodal-work-revisited-by-shannon-mattern\/\">visit her article<\/a> in the <a href=\"http:\/\/journalofdigitalhumanities.org\/\"><em>Journal of Digital Humanities<\/em><\/a> to read these questions and follow the links to the community discussion that inspired this work. Note the importance of <em>process<\/em> in the evaluation themes and questions. Also visit Dalhousie University Library's <a href=\"https:\/\/docs.google.com\/document\/d\/1F45I5a7FJUwhu1-tIXqDv9Z4Cwgvpy1VxsyZt7D9Cr0\/edit\">Digital Humanities Project Planning template<\/a> for a list of questions that align with the managerial, communication, and technical competencies that can be developed through DHSS. Both resources emphasize the\u00a0<em><strong>experiential<\/strong> <\/em>aspect of students' DHSS assignments, which is a key aspect of the work of DHSS.<\/p>\r\n<p class=\"no-indent\"><strong>In your rubrics, we recommend providing expectations that cover:<\/strong><\/p>\r\n\r\n<ul>\r\n \t<li style=\"list-style-type: none\">\r\n<ul>\r\n \t<li><a href=\"https:\/\/teachingcommons.yorku.ca\/resources\/experiential-education\/\">Experiential learning<\/a><\/li>\r\n \t<li>Project management \u2013 timelines, articulated goals for completion<\/li>\r\n \t<li><a href=\"https:\/\/docs.google.com\/document\/d\/1g76IN9mQtQce5D-aARubxSSW_5nnTDLinkHWR87Cnjg\/edit?usp=sharing\">Question\/answer structure (thesis) and use of evidence<\/a><\/li>\r\n \t<li>Presentation\/use of tools and technologies<\/li>\r\n \t<li>Collaboration (if relevant)<\/li>\r\n<\/ul>\r\n<\/li>\r\n<\/ul>\r\n<p class=\"no-indent\"><strong>Visit <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-6-assess-accordingly\/\">Step 6: Assessment<\/a> for links to helpful rubrics to engage in your DHSS assignments.<\/strong> Also see the different <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/part\/assignment-guides\/\">Assignment Guides<\/a>\u00a0in this Instructor's Guide for tips about assignment-specific elements for evaluation and assessment.\u00a0You may also find <a href=\"http:\/\/pontydysgu.org\/wp-content\/uploads\/2007\/11\/eva_europe_vol2_prefinal.pdf\"><em>Evaluating E-learning: A Guide to the Evaluation of E-learning<\/em><\/a>, edited by Graham Attwell, a helpful resource for thinking about evaluation and learning outcomes for e-learning more generally.<\/p>","rendered":"<p class=\"no-indent\"><strong>As with any assignment, students must be given clear expectations for a successful DHSS project.<\/strong> Product is important, but assessing students on <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#exlearning\"><em>process<\/em><\/a>\u00a0is even more important in a DHSS project where students may be working with concepts, tools, technologies, and materials that are different than what they are used to. Instructors must have patience with students so that students can come to understand the ways they are being pushed to do and think in new ways because of DHSS. This may involve explaining the expectations in different ways, providing <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-6-assess-accordingly\/\">clear rubrics<\/a>, and pointing students back to the course&#8217;s <a href=\"https:\/\/teachingcommons.yorku.ca\/wp-content\/uploads\/2015\/02\/Learning-outcomes-worksheet.pdf\">overall learning outcomes<\/a>. Most realistically, however, the assignment will require you to do all of those things.<\/p>\n<p class=\"no-indent\">A traditional essay is (usually) just evaluated on the final product: the written paper. <strong>But DHSS, as it is framed in this Instructor&#8217;s Guide, is based on learning through <em>experience<\/em> \u2013 <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#exlearning\">experiential learning<\/a>.<\/strong> Students&#8217; experiences \u2013 the process behind the product \u2013 need to come to the fore in evaluation and assessment. Your articulation of the assignment and assessment criteria can help students in making the shift from <em>just<\/em> product to product <em>and process<\/em>.<\/p>\n<p class=\"no-indent\">With clearly written assessment criteria, students learn what you want, how it fits into the course, and how it will be assessed. At the same time, however,\u00a0you should also be open to a final product that may look different than you originally expected; time, resources, and space for interpretation can morph a final DHSS product in ways you may not be able to predict at the start. This is how students will learn from the <em>experience<\/em> of creating their DHSS project. They need to know that sometimes failures and false starts are part of the process of <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-5-engage\/\">engaging<\/a> in DHSS and that your assessment has room for this exploration.<\/p>\n<p class=\"no-indent\">In an example of a professor needing to be clear about, and thus clarifying, her expectations for a DHSS assignment,\u00a0<a href=\"https:\/\/amandastarlinggould.com\/\">Dr. Amanda Starling Gould<\/a> taught a course at for <a href=\"https:\/\/duke.edu\/\">Duke University<\/a>\u00a0in 2013 titled \u201c<a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/\">Augmenting Realities: Technoscience, Digital Art, &amp; Electronic Literature<\/a>\u201d. The final assignment was a \u201c<a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/assignments\/\">transmedia essay,<\/a>\u201d which she described in the syllabus as \u201cthe equivalent of an 8-12 page (double-spaced) scholarly article.\u201d She explained to her students that they would &#8220;augment&#8221; the traditional format of an essay by inserting media, links, and the integration of a &#8220;(Re)Mediated Element&#8221; into their assignment. Although this &#8220;(Re)Mediated Element&#8221; may have been clear to Dr. Gould, <a href=\"https:\/\/sites.duke.edu\/lit80s_02_f2013\/evaluating-digital-humanities-projects-collaborative-course-assessment\/\">students had questions about it<\/a>\u00a0and logically asked whether they were just adding a media to a traditional essay.<\/p>\n<p class=\"no-indent\">Students&#8217; questions provided the opportunity for Dr. Gould to (re)explain her vision of a &#8220;transmedia essay&#8221; to her students and to clarify what the assignment involved. Gould explained to her students that rather than adding media to a standard essay, &#8220;<strong>I want you to CREATE something or ANALYZE something or MAP something or REMEDIATE something<\/strong>.\u201d This new media element, she explained, \u201cshould be chosen based on its ability to do something that paper cannot do.\u201d In this way, she encouraged her students to \u201c<strong>think of your media element as an experiment that extends and\/or explores the questions you are asking in your work<\/strong>.\u201d This element of their assignment would expand students&#8217; critical exploration of the subject matter because, she argued,\u00a0\u201cpresenting data in a different format, if done thoughtfully and accompanied by a critical essay exploring what those different format presentations mean (or say, or do, or are commenting on, etc.), CAN be an argument or relevant contribution to a written work.\u201d<\/p>\n<p class=\"no-indent\"><strong>Articulating this shift in expectations \u2013 <\/strong>from adding media to an essay to <strong><em>creating and integrating media\u00a0<\/em><\/strong>in an essay in a way to demonstrate, develop, or prove an argument \u2013 <strong>prepared students to think about the act of <em>creation<\/em> as central to their work<\/strong>. Gould emphasized that it was not just the final \u201ctransmedia essay\u201d that students should focus on, but rather the investment in thinking about what a \u201c(Re)Mediated Element&#8221; may, can, and will do in the service of advancing their ideas in the course. Gould also mentioned that she would bring in and show examples to the class, grounding her vision with references that she can discuss with her students.<\/p>\n<p class=\"no-indent\">Through these exchanges with her students, Gould identified what she wanted from a &#8220;transmedia essay,&#8221; explaining to students how her expectations were both similar and different to a traditional essay and how this work tied back to overall learning in the course. This is good pedagogical practice overall, as identified by <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/dhssintheclassroom\/#hunter\">Madeleine Hunter<\/a>, but is especially important because of the newness involved in a DHSS assignment.<\/p>\n<p class=\"no-indent\">Dr. <a href=\"https:\/\/t.co\/5ui9t54NF4\">Shannon Mattern<\/a>, Associate Professor in the School of Media Studies at The New School in New York, explored how to <a href=\"http:\/\/journalofdigitalhumanities.org\/1-4\/evaluating-multimodal-work-revisited-by-shannon-mattern\/\">evaluate assignments with multiple forms of media<\/a>, like the transmedia essay, and identified the key themes one should use to evaluate these types of students&#8217; projects. These include:<\/p>\n<ul>\n<li>Concept &amp; content<\/li>\n<li>Concept\/content-driven design &amp; technique<\/li>\n<li>Transparent, collaborative development, and documentation<\/li>\n<li>Academic integrity &amp; openness<\/li>\n<li>Review &amp; critique<\/li>\n<\/ul>\n<p class=\"no-indent\">Under each theme she provided a list of questions that framed her evaluation of that theme.\u00a0I encourage you to <a href=\"http:\/\/journalofdigitalhumanities.org\/1-4\/evaluating-multimodal-work-revisited-by-shannon-mattern\/\">visit her article<\/a> in the <a href=\"http:\/\/journalofdigitalhumanities.org\/\"><em>Journal of Digital Humanities<\/em><\/a> to read these questions and follow the links to the community discussion that inspired this work. Note the importance of <em>process<\/em> in the evaluation themes and questions. Also visit Dalhousie University Library&#8217;s <a href=\"https:\/\/docs.google.com\/document\/d\/1F45I5a7FJUwhu1-tIXqDv9Z4Cwgvpy1VxsyZt7D9Cr0\/edit\">Digital Humanities Project Planning template<\/a> for a list of questions that align with the managerial, communication, and technical competencies that can be developed through DHSS. Both resources emphasize the\u00a0<em><strong>experiential<\/strong> <\/em>aspect of students&#8217; DHSS assignments, which is a key aspect of the work of DHSS.<\/p>\n<p class=\"no-indent\"><strong>In your rubrics, we recommend providing expectations that cover:<\/strong><\/p>\n<ul>\n<li style=\"list-style-type: none\">\n<ul>\n<li><a href=\"https:\/\/teachingcommons.yorku.ca\/resources\/experiential-education\/\">Experiential learning<\/a><\/li>\n<li>Project management \u2013 timelines, articulated goals for completion<\/li>\n<li><a href=\"https:\/\/docs.google.com\/document\/d\/1g76IN9mQtQce5D-aARubxSSW_5nnTDLinkHWR87Cnjg\/edit?usp=sharing\">Question\/answer structure (thesis) and use of evidence<\/a><\/li>\n<li>Presentation\/use of tools and technologies<\/li>\n<li>Collaboration (if relevant)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p class=\"no-indent\"><strong>Visit <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/chapter\/step-6-assess-accordingly\/\">Step 6: Assessment<\/a> for links to helpful rubrics to engage in your DHSS assignments.<\/strong> Also see the different <a href=\"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/part\/assignment-guides\/\">Assignment Guides<\/a>\u00a0in this Instructor&#8217;s Guide for tips about assignment-specific elements for evaluation and assessment.\u00a0You may also find <a href=\"http:\/\/pontydysgu.org\/wp-content\/uploads\/2007\/11\/eva_europe_vol2_prefinal.pdf\"><em>Evaluating E-learning: A Guide to the Evaluation of E-learning<\/em><\/a>, edited by Graham Attwell, a helpful resource for thinking about evaluation and learning outcomes for e-learning more generally.<\/p>\n","protected":false},"author":21,"menu_order":4,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-38","chapter","type-chapter","status-publish","hentry"],"part":23,"_links":{"self":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapters\/38","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/wp\/v2\/users\/21"}],"version-history":[{"count":28,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapters\/38\/revisions"}],"predecessor-version":[{"id":1092,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapters\/38\/revisions\/1092"}],"part":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/parts\/23"}],"metadata":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapters\/38\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/wp\/v2\/media?parent=38"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/pressbooks\/v2\/chapter-type?post=38"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/wp\/v2\/contributor?post=38"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks-dev.library.yorku.ca\/dhssinstructorsguide\/wp-json\/wp\/v2\/license?post=38"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}