Check out the Latest Articles:
User Testing | March 31, 2009 & April 6, 2009

Session I | March 31, 2009

Heuristics:

  • Interact with user interface easily.
    • results : The students did not have trouble navigating the site.  As time was short, they did not have an opportunity to really experiment with searching for background information on the source.  Also, it did not take them long to take to the Kaltura interface.
  • Be interested and engaged in project.
  • Show understanding of what is asked.
    • Students needed prompting to develop their ideas.  More experience in a wider variety of classrooms would answer the question of if this is normal or not.  Answers to questions came easier to them as they began to understand what they were doing.

Changes Made from Past Experience:

  • Had students read aloud the article this time as it was a difficult task to manage the first time.

dsc_0517dsc_0516dsc_0515dsc_0514dsc_0513dsc_0512

Things Forgotten:

  • Directions must be clear, concise, and in a language they understand.  My focus before testing had been much more on development of the back end and strayed away from how to explain and integrate into the curriculum.  These steps should be made OBVIOUS.

Assumptions:

  • That students would understand the article upon reading it.
  • That they would be familiar with big ideas like “fuel-efficiency”.
  • Timing Timing Timing : even in the analog we were not able to get through all that we needed to in the right amount of time, and I guess I should have realized that this would be the case with the digital, as well.
  • Resources:  I was told that there would be computers for nearly all of the students, but really the groups were 5 students to a computer.  This is not the way it should be and it really affected how some of the students responded.  Collaboration is important, and there should be an understanding that unfortunately some kids are going to participate more than others.
  • Time Enough to Produce Results:  Due to timing and other restraints it was difficult to feel as if there was a solid product produced by any of the groups.  It would seem that more time and practice is needed.
    • BAD NEWS:  it is difficult to feel the project as a success when there aren’t solid artifacts produced.
    • GOOD NEWS:  there is a great need for teaching the students how to do this.  There is a great lack of skill in their abilities where this sort of critical analysis and reconstruction of ideas is concerned.  Big opportunity

Observations & Results:

  • Need to break it down — too much information was delivered at the same time.  My own mind was in the code and functionality rather than in the flow of the program’s introduction into the classroom environment.  This needs to be remedied.
  • Students need a great amount of help developing their analysis and ideas.
  • Students LOVE to be let loose with the media, but there needs to be DISCUSSION about what is appropriate for the school environment.  This is a really major issue that requires practice, and perhaps some

Next Steps:

  • Introduce students to HOW to do this more methodically and in a more organized way.  List important QUESTIONS that they should ask themselves.
  • Develop a resource about how to STORYBOARD.
  • Use Kaltura itself to INTRODUCE students in a clear and concise fashion the way that DeepFried Media works.
  • CONSTRAINTS are integral to success.  Students are given access to the media of the world through
  • Students should have the article assigned as homework — it simply takes up too much time to read, absorb, analyze, & remix all in a one hour class period.

Session II | April 6, 2009

Changes made this time:

  • “How to Storyboard” was introduced to the students at the beginning of the class.
  • Added CONSTRAINTS to the remix.
    • Use 1 piece of video
    • Use 1 song
    • Use as many images as you like
    • Aim for a 30 second remix

storyboardhowto
storyboardhowto2

Questions:

  • In an effort to communicate better the questions that the students should ask themselves.  I wrote questions on the board:
    • What is the STORY?
      • Helpful Hint — make lists
    • What do YOU think?
    • What are the BIG IDEAS?
    • How would you TEACH this to another student?
    • Why should I (the audience) CARE?
    • Remember:  Longer is not always better.  Ask Questions — Questions are Good.
    • Simplicity is key.  Don’t over-complicate things.

Assumptions:

  • That upon explaining how to storyboard, the students would be able to take this non-digital exercise and run with it.  I just forget that the students have more questions than I could ever dream up!  I need to refine the “How to Storyboard” handout as there is TOO MUCH TEXT.  Perhaps it could be helpful to make a presentation and film a screenshot with my voiceover.
  • THAT TECHNOLOGY WOULD WORK.  Yes, this is always cause for concern.  It’s not as if Kaltura didn’t work, but sometimes it was a little testy.  I am going to look into if there are widgets that are more stable.  Or perhaps it would be more stable if some of the options were removed.

picture-6picture-7picture-9picture-10picture-11

Observations & Results:

  • This day was far more successful than the first testing.  The incorporation of an analog planning time is very important.
  • Although intuitive, there is a learning curve for using this sort of thing (Kaltura).
  • AGAIN, time got the better of us and students were unable to finish their projects.

storyboard1astoryboard2astoryboard4astoryboard5astoryboardnotes1a

Next Steps:

  • Video Wrap-up:  Create a video with debriefing questions that can spur on discussion.  Bring the critical analysis back to their work.
  • Further development of functionality
    • Play more with customizing the kaltura api to enhance experience
    • create rating and discussion boards for profile pictures
  • Develop more scenarios for how it can be used
    • Be honest about how many days it takes to teach how to fully use it and what the challenge actually is.
  • I really wish that there were more time to work in the “who is the source” element of the project.  Some of these tasks are much more simple and are a part of the step-by-step analysis.  For instance, since we were unable to do this part, we never came up with the list of “big ideas” from the article.  This left the students still asking questions about the article itself.  In addition, perhaps there should be some challenges or prompts about “devices” used in the article.  This might be too advanced for this age group, however.  This question requires further thought.
  • “How to Storyboard” resource should be more fully developed with video?  Or at least more imagery.
  • SCRIPTS: I need to work on “Resource” scripts for how to use the various elements and also “how to storyboard” “how to integrate this into your curriculum”, etc.
  • Perhaps play up the “Roleplaying” element.  Should they be referred to as the Editors?  There should be some new language to help them understand what they’re doing.


  1. It‘s quite in here! Why not leave a response?