-: All right, I see that folks have arrived.
So welcome, everyone.
This workshop is introduction to
the Brightspace Quiz Tool
and it's facilitated by Desire to Learn.
Brightspace's parent company.
This session will be recorded and published
to the Brightspace implementation website.
So you can review this recording at any time,
just give us a week or so.
I think it'll be closer to 10 days until we can get it back
from our captioning services to get that finalized
and then we'll publish this to the website
and we'll let y'all know when it's up there.
The session will be an overview of how to create quizzes
and the questions associated with quizzes in Brightspace.
Note that this is like an overview of the quiz tool
and we'll have follow up sessions to go deeper on quizzes
beginning in the first week in October.
And again, we'll be in touch
when those sessions are available for registration.
We will use the chat for question and answers,
so please enter your questions there
and if we don't know the answer
and we have to do a little bit of research,
please know that we will get back to you.
Our session will be facilitated by
Desire to Learn's Trainer Jackie Nehls.
Jackie has worked in in education
and corporate training for 15 years.
She's a certified adult educator with an a degree
in higher ed management
and she's currently setting at McMaster University.
And with that I will hand things over to Jackie.
Thank you.
Jackie: Well thank you, Wendy.
And hello, everybody.
Welcome to our session.
We just have one quick hour to share with you
and introduce you to the quiz tool.
So with that being said,
we will be recording as you know
and we just wanted to share the legal disclaimer.
We ask that you do not share this outside
of your environment because we are working
with confidential and proprietary information.
So just so you're aware,
please don't share it out to TikTok or YouTube.
Quizzes, one of my favorite topics.
What we're gonna do is take a high level overview
and a bit of a deeper dive than you may have seen before
in one of our previous sessions.
But again, there's so much to share with you.
There will be further sessions with further deeper dives
as you move forward.
What we wanna share with you is the workflow
of creating a quiz, and this will include, and again,
not limited to some of the topics you'll see
on my screen right now,
With questions that you build within a quiz,
we can do a number of different things,
including adding some multimedia to questions.
We can add feedback or hints,
we can add short descriptions.
We have quiz question types,
including a written response question type.
This will allow students to even insert their own media
or record a video if necessary.
We do recommend and we will share with you
what the question library is in Brightspace.
If you're familiar with other LMS tools,
you may have seen something similar to this,
but we will again be looking at building a quiz,
grading a quiz,
and looking at some of the statistics that are built
behind the scenes of the quiz at the course level.
So some of this we may have shared in other trainings,
but again, today we're going to look
more in depthly at the quiz tool.
You may be asking what is the quiz tool?
Well, the quiz tool can be utilized
for several different purposes.
We can use it as just a pop quiz.
We can use it as an engagement tool
to see how our students are learning.
We can set up midterm and final exams
and it's really about measuring assessments
within the system.
With the quiz tool in Brightspace,
you can also build a survey or a self-assessment
so you're not just limited
to a basic quiz or midterm or final.
And we can choose a range of question types to create
different components or different responses
from our students.
We'll share with you the different types
of questions you can build,
but you can also create something
we call question pools.
In Brightspace, a question pool
is where you can randomly select questions
that will be given to the students
at different times in a quiz.
And we have several settings that you can set for your quiz.
Now with the quiz tool, it is an auto gradable feature,
so with the exception of two types of quiz questions,
the Brightspace system will auto grade your quizzes for you.
Those two types of questions are written response
and likert scale
and we'll talk about those as we move forward.
One of the big things we wanna share with you is
the question library and the question types
that we'll really look into today.
The question library is a repository of sorts where we
recommend that you build all of your quiz questions
for your course
and in that manner you can use the questions
over and over again,
but it is a repository and we'll save those quiz questions
for you regardless of which quiz you're adding them to.
It does keep track of which quiz questions you've used
throughout the course so you can keep a mindful eye
as to where you've used these questions,
how each question did with the students, how they fared.
So we'll talk about the question library.
Within the library you can build sections,
you can build different types of questions.
We also have a feature of branching questions.
Now branching questions are a different question type
that dependent on how the student
answers the initial question,
it brings them to a different branch.
So if they answer true,
you could branch it to another question
that relates to that response versus if they answered false,
you could branch it to a different question
with a different response.
Now in terms of question types,
we have true, false, multiple choice,
multiple select, written response, short answer,
and as you can see on my list,
there are several different question types
that you can build.
When you build a quiz question,
depending on the type that you choose,
the system will prompt you to add the different components
to meet that question type.
Now when we build our questions in our quizzes,
we can again auto export the results to the grade book
or set it to an instant grade availability.
Now because it's auto gradable,
we can either send the quiz result
to the student immediately
or we can keep it behind the scenes
and then publish it at a different time.
With our quizzes, you can customize the availability,
the time limits and the flexibility of those limits.
Now in terms of flexibility of limits,
that means that we can set a recommended time where we
believe the student should complete the quiz in this time.
However, if they go over the recommended time, it's okay.
The system will keep track of that time.
However, the student will not be kicked out of the exam
or quiz and kicked out may not be the right term,
but they won't be bumped out, I guess you could say.
We can also set time limits with parameters.
So for example, you could say
this quiz must be done in 30 minutes
with a five minute grace period.
When we build our quiz,
we can also disable any communication from Brightspace
that occurs during that quiz
so students are not distracted
and we can customize what the students see
when they click submit.
So there's a lot of details when building the quizzes,
although it's a very quick four step process.
Now as I mentioned, you can also build self-assessments
and surveys using the same type of functionality
as the quiz tool and we have statistics
built right into the quiz itself.
In viewing statistics, you can look at quiz results
with the user statistics.
So overall in my course, how did the users do?
Question statistics, so with each question,
how did my users respond and question details.
Of the answers provided within a quiz question,
how many of my students answered correctly,
incorrectly and what were their responses?
With the statistics,
you can export the results out to share with a team member.
You can also export it to an Excel or CSV.
You can also choose how many attempts students have
and then use your statistics
to view how many attempts did it take
for my students to be successful.
If that's the case,
I may want to change any quiz questions
or adjust the content that builds that quiz.
So that's the basics of the quiz material
that we wanted to share with you in PowerPoint.
Now I'm going to take you out to the environment
where we're going to start to build.
You are welcome to log into your environment
and go into your sandbox course
where you can build along with me
or simply follow along with my screen.
I'm in the UVM site and I'm going to utilize my sandbox
to share with you how we can build
and create some quizzes,
as well as using the question library,
the quiz, statistics and other tools.
Now once we're here, again you can find the quiz
under this activity's drop down,
or you can always use the course admin tool tab,
which takes you to the behind the scenes
of your course to finds the quizzes option.
When we look at the quiz tool,
we are given a dashboard where it shows us
which quizzes have already been created.
If you have no quizzes created in your sandbox, that's okay.
Once you start to build them, they will be listed here.
When we first enter this section or this dashboard,
we can first come into this manage quiz view
where it shows us a list of quizzes
that have already been created.
The next tab at the very top,
just below the nav bar is the question library.
Now yours might be blank this moment,
but we will share with you how you can build questions here.
Statistics allows you to go and look at the statistics
of the quizzes that have had responses
from your students within your course.
We also have the lockdown browser here.
When you click into this area,
it will show you the lockdown browser dashboard
where you can manage the lockdown browser component.
The next three buttons we see is building a new quiz.
Within the quiz tool, you can create categories.
Now this is not a required step,
but it is an available step where you can categorize
or put into folders the quiz that you build,
whether it's by topic matter, by module or unit,
you can build those categories
to sort of organize how your quizzes appear.
The more actions tab allows you to do
a number of different functionalities,
and as you know already whenever you see this drop down
or chevron, there's lots more actions that you can take.
Now if you've built quizzes already
in your dashboard in your course,
you will be able to reorder how they appear to the students.
You can make any quizzes visible or hidden,
which means if it's hidden,
students will not be able to see it
in their course dashboard.
You can also delete a quiz and if it's deleted in error,
you could restore it back to the course.
Now, if you have built some quizzes,
you can bulk edit those quizzes.
All you would have to do is click on this little box
at the top of this table in your dashboard
and select bulk edit.
Now again, this is only useful if you've built some quizzes,
but from this bulk edit you can change the name.
If you've selected a category,
you could adjust that category name or add a category,
make it hidden or visible to students and provide
different attempts which would be allotted
to the students to take this particular quiz.
Now, in building a quiz, we do recommend that you
build all quiz questions in the question library.
However, you can always create a new quiz
from scratch by clicking this blue new quiz tab.
The reason we recommend a question library
is because as you build them here in this question library,
they will be saved and can be used in other quizzes.
If you were to build a new quiz from scratch,
those quiz questions will live in that quiz you're building
versus in the library where you can use them
again and again.
Now, I have a question library here in my example,
so I'll show you how this works,
but if you were to build some questions
in your question library,
you would simply select question library and click new,
select the type of question you wanted to build
and begin to build.
You can also build new sections,
which means you can section question types
or by topic matter in the section itself.
And then as you can see over here
on the left hand side of my screen,
I have a sample section with quiz questions inside of it.
Now, the question library allows you
to move questions about, delete them,
order them, edit to the point values
you would allot to each question,
and you could even in fact publish
to what we call the learning object repository,
which we will talk about a little bit later.
Now what we're going to do
is build a question from scratch
to take you through the workflow
of how to build a basic quiz,
but again, always be mindful.
It's best recommended to build
those questions in the question library.
When we build a quiz,
there's four basic steps to building the quiz.
We would click new quiz and step one comes along
this tab at the very top of our screen.
Properties.
This is building the properties of the quiz
and the first one is to give this quiz a name.
Now you have the opportunity to give the quizzes
within your course your own name
and conventions based on topic matter, section, timeframe.
It's really up to you and the curriculum within your course.
You could if needed, build a category
for this particular quiz or attach it to a category
that already exists.
In step one, here's where we can add or edit questions.
This workflow in adding or edit questions in a new quiz
is the same as building a new quiz question
in the question library.
So I'm just gonna click add or edit questions
and it gives me a couple of other options.
First, we could click add to build a new question
or a new section within this individual quiz,
we can also build a question pool,
which we will come back to.
When I select new question,
I have a long list of questions that I can build.
To begin, we're just going to click true and false.
Now, all of the question types work very similar.
As you start to build different question types, again,
you will be prompted as to what features
you would need for that quiz question to function.
Right now we're just building a simple
true and false question.
When I open up and click into this question text area,
this will allow me to text in, copy and paste
or add the question text asking the question for this quiz.
So for example, I may say
today is Wednesday.
Now again, you can type any quiz question text here,
but you can do a few other things as well.
You'll notice when I'm inside of this question text area,
I have what we call the mini Brightspace editor
that I can click into and add components
to my quiz question text.
You can format it, make it bold,
italicize any of those functions,
and we can come to this power button here
called insert stuff.
When I select insert stuff,
this will allow me to add something for my computer,
course offering or public files,
as well as record up to a 30 minute video.
In this quiz question, I can go to my media library,
add multimedia inside of this quiz question text
if I so choose,
even adding or inserting a link
or an embed code directly in this quiz question.
So if I wanted to add a YouTube video to this quiz question,
whereas students would have to answer a question
pertaining to that media,
I could very quickly and easily do so
For this particular option,
I can insert a URL by copying and pasting that URL
directly into the quiz question.
That's one option. Again, as mentioned,
you could add or record up to a 30 minute video message
describing the text or what you're expecting
from the students in that quiz question response.
Or we can go to our video note search
and if we've previously recorded an audio video note,
we could search for that here.
Now I'm searching for any welcome videos
that I've previously recorded, so I have some,
I could just simply click into this one
and it would be added to the quiz question text
so you can quickly and easily
add documents and media to your quiz question.
We can also this chevron beside this plus sign.
In this manner using the Brightspace editor,
we can add an equation using our equation builder.
So for example, if this isn't a basic true false question
asking what today is,
I can click into the equation and using this tab
I can build a graphical latex, math ml
or chemistry equation.
Just to share with you how this works,
I'm gonna click on graphical equation
and the popup appears on my screen
allowing me to build which equation I've selected.
I'm not very good at math, but I will share with you,
it's a couple of clicks
and your equation can be for you.
If you're more familiar with source coding
in building mathematical or chemical equations,
you can always come to this symbol here
to use the source coding instead of the equation builder.
Now again, we're just building a basic quiz question,
but you can add a table.
You can also insert what we call a quick link.
So very similar to our HTML editor
in other places in Brightspace.
We can click on insert quick link and we can actually link
something that's already created in our course
as reference to the quiz question text.
So for example, I could jump into the quick link tab,
click on content, click on course overview
and link something that's already
built in my course to this quiz question text.
In this manner, students would not have to go back
to content to go and look for this content.
It's already quick linked directly to my question text.
You can add an image.
So again, if you want the students to look at an image
and respond to that question using that image,
you can very quickly and easily click insert image,
drag something from your computer, URL
course offering or public files.
Now just to remind you, course offering files
or files that are behind the scenes of your course
and public files or files that you have
as an organization available to you.
Public files are more so like a logo
versus an in depth course content file,
but it is available to you.
Now again, you can just go to your computer or to a URL
and copy and paste something such as an image drag
and drop it directly in your question text for your quiz.
As always, we're very mindful within Brightspace
about assisted technology.
So when adding a video, when adding an image,
it's going to ask you to convey
what that video or image is portraying
for this question text,
I'm just gonna state that this image is decorative
for our demonstration today.
And as you can see, it took me a matter of seconds
to add an image to this quiz question.
If you're adding an image or if you're adding multimedia,
you do have the option to edit that image
and a small editor will appear with that image
or with that video so you can make
appropriate edits to that.
Now, once we've created our question,
we now need to tell the system what the correct answer is
for the auto grade to work.
You'll notice there is an asterisks here
which tells us that this is a required field,
so I cannot continue to build until I tell the system
what the correct answer is.
So yes, I think today is Wednesday.
Although, Justin, you may have to confirm that for me.
The next area we have is the point value
for this quiz question.
Now it defaults to one at every question you build.
So you need to come down and just add the custom point
that you would like to allot
for this particular quiz question.
This can be changed and edited
when you're completed building your quiz.
Sometimes when we build quiz,
we don't think about the points until afterwards, but again,
you can always edit to the point value
for the individual quiz question after you've built.
Now, when we're building a quiz question,
it's going to populate on the right hand side of the screen
and this is just a preview for you to see
what the quiz question will appear
as for the student when they take the quiz.
We also have at the center top of our screen
at this options tab,
the options tab allows us to add
more features to this individual quiz question.
We can add feedback.
Feedback will appear to the student if you choose to show
them once they've submitted to the quiz.
When you click on add feedback,
you have fields that open up for each response
the student has the option to select.
So for example, if my student has answered true,
what feedback do I wanna provide to them?
So as you can see, when I'm providing feedback
I can type in text, but in each area
I also have the use of my insert stuff, as well as
that plus sign where I could actually provide more feedback.
A great use case for this is if you wanted to provide
feedback that pertains to the content or a link to something
within the course or add a video that just pertains
to the response the student has given.
So you can insert media, insert a video, insert a link,
all the options are still available in your feedback field.
Again, feedback will only be seen by the student
once they submit the quiz
and if you allow them to see that feedback.
Another option when you click the options drop down
is where you could add a hint.
A hint will be seen by the students during the quiz.
So for example, again,
once you click into this hint text box,
you could add something from insert stuff, type in a hint,
but a hint again is seen while the student
is taking the quiz.
You can add a short description.
Again, this will be seen during the quiz
and when you select short description,
you do have a text box.
Now with the description, you do not have the availability
to add features such as the HTML components,
but you can type or copy and paste
your short description here.
It may just be relating to the content topic.
It may be a case study where you're giving a description
of some of the answers you want them
to answer within the quiz.
Many different options to use the short description.
Now the final option here is add enumeration.
You'll notice here on my preview of my quiz,
there's no enumeration.
So you have the option to add enumeration to your quiz
and numeration options will be A-B-C,
lowercase or uppercase,
roman numerals, lowercase or uppercase.
But you have the option to choose
your enumeration type when you scroll down.
So once you selected all of the options,
you've added your text, your feedback,
your hint if required,
you would simply click save.
If this is a detailed question,
you could save and copy.
When you save and copy it copies the format
of the quiz question you've just built
so you can build another one that's very similar to that
or you could save and start to build another new question.
At any time, you can choose a different type of question
and start to work within that question type,
following the prompts on the screen to build that question.
This is an example of a fill in the blank.
You can allot certain points at a level of difficulty.
You can even insert images for each question response.
You can add more fields and you will notice,
with each fill in the blank or each area,
you have your Brightspace editor.
Within these larger context quiz types,
you can preview by clicking preview
because there's so much going on in the screen as well.
So step one, give it a name, add some questions.
We can continue to add.
We can go to new question, build a section,
or again as we mentioned, a question pool.
When building a quiz, we can also import.
Now import means we can upload a file from an outside source
or because we've already built
a question library in our example,
I can browse the question library and import questions
from the library into this quiz three.
We can also import from what we call
the learning object repository
and that is a cloud space attached to your organization.
And again, we'll introduce this a bit later.
Now, when we upload a file,
we are given an option to upload a CSV template.
We do recommend that you download the template first
and then fill it out and upload.
We can also import from the question library.
So when I select browse question library,
I can choose a number of different questions
that I wanna add to this quiz three.
So you'll see how quickly when I use the question library
to build my questions,
how quickly I can bring them into another quiz.
You'll also see which other space
within your course this question is,
and currently these questions
are only in the question library.
At any time, you can preview to see what your quiz
will look like for your students
and you can return back to the quiz to set more settings.
Now you can choose to prevent moving backwards
between pages, which means students
will not be able to go back to add more responses
to other quiz questions.
And you can shuffle the questions
for multiple attempt quizzes.
Now step two, adding restrictions.
This is where you can hide it from the users.
You can add due dates, start dates,
end dates or release conditions.
By default, all quizzes are hidden from users
until you're ready to publish them,
and that is done by default
just so that if you're building a quiz,
it's not released to the student before it's ready.
With release conditions,
you can add existing or attached new,
such as they may not do this quiz
until they've received a certain grade
or seen some content before.
And we also have the option in step two
for security options.
So this deals with the response lockdown browser
where students are required to take the quiz
or required to view the quiz feedback and results.
This is the third party tool that works with Brightspace.
So with the respondent's lockdown browser,
you can make these other selections.
For advanced restrictions,
you can provide a password based on the IP address
that the student will be using to take the quiz.
And here's that timing we spoke about.
So with the timing, you can choose a recommended time limit,
which allows the student to take as much time as they need,
although we've recommended a time,
or you can enforce the time limit.
Enforcing the time limit means when that time is up,
the student will be bumped out
or the quiz will stop for them.
With the enforced time limit,
you can also add grace periods with parameters specific to
that grace period and you can add special access,
allowing certain students a little bit more time,
recommended versus set times,
more attempts and different time ranges.
Now step three is the assessment.
So how do you want this to be assessed?
Meaning, do you automatically wanna publish the attempt
or the result to the student once they submit?
Is this going to be attached to a grade item
in your grade book?
And if so, are you synchronizing the grade
with the grade book and releasing
that grade to the students?
In some circumstances,
you can release the grade to the student.
They will get a notification with an orange dot
above the bell icon saying
that their grade has been released.
Conversely, you cannot release the grade
and release the grade at a later time.
In step three, we'll see what the students can see
in their grade book and we can choose
how many attempts we would allow the students
to take for one particular quiz.
Now we're building quiz three.
So perhaps for the quiz three,
I want my students to take three attempts.
I'm gonna click apply.
With the attempts, not only can I choose
how many attempts the students
will be allotted for quiz three,
but I can also choose a few other details.
So for example, if I'm giving them
three attempts for quiz three,
I can say on the other attempts
they will only be able to take incorrect answers
if I select this tab here.
Otherwise, every time they take an attempt,
they'll have the full quiz to complete.
On top of which with the attempts,
I can also choose different attempt
minimum and maximum scores.
So for example, if I want my students
to take this to achieve a specific grade,
I can say for the first attempt they must achieve
specific grade before they can take the second attempt.
So for example, before they can take attempt two,
they should achieve anywhere between a 45 and a 55.
If they meet within that range,
then I'll give them a third attempt
such as anything from 55% to a maximum of 85.
Now I've given a maximum of 85 in this example
because perhaps if a student is taking multiple attempts,
I don't wanna allot them the full grade value for this
because it did take them multiple attempts,
or you don't need to necessarily use the minimum or maximum
for different attempts.
You could tell the system of the attempts
that the student takes,
which is the final grade I'm going to accept for quiz three,
Is it the highest, the lowest, the average,
the first or the last?
So you have a lot of flexibility here in this attempts view,
students have the availability
to take as many attempts as possible or up to 10 attempts.
The final step is submission views.
Now with submission views, you can customize
what the students see once they take the quiz.
Now for the submission view,
you can create this submission view here in this dashboard
and then assign which submission view
is allotted for which quiz.
Now the submission view can reveal to the student
how they did, which quiz questions
they answered correctly or incorrectly.
You can choose a number of different criteria
that the submission view will have.
So for example, I can click add an additional view,
give this view a name.
Attempt,
one,
quiz three,
or I can create a submission view for all attempt one.
In this area, I would leave a message,
so if this is the first attempt
submission view for quiz three,
I may say thank you
and I might just say, you know,
please try again after reviewing this link
or content
and just give them instructions
as to what is expected for attempt two.
Now I can insert an image, insert stuff,
add a quick link and link it to content that I want them
to review before they attempt a second attempt.
Provide any of my messaging here.
With each submission view,
I can restrict how long this will be seen by the students.
I can restrict a specific IP address,
the attempt that I want them to take.
So this is attempt one submission view.
I can even determine a different submission view
for the score that they achieve.
So for example, if they are meeting a minimum score
of 45 to 55 in this view,
then I can customize the messaging in my area here.
I can then say what I want them to see.
So do I want to show them only the incorrect answers?
Do I want to show them the answers they selected correctly?
All questions and so forth.
I can be very specific with each submission view
that the student sees based on the quiz
and the score that they've achieved.
I can also show them the class statistics if I decide
and the score distribution of that particular quiz.
Once I've created my submission view,
it will then be loaded here.
And then as you can see,
I can attach this particular submission view to quiz three
based on the parameters
and decisions I've made for this view.
So in 30 minutes or less,
that is the basics of building a quiz.
Wendy: Jackie, excuse me.
Jackie: Now to share with you what that's--
Wendy: Can I interject here for just one second?
Jackie: Yeah, go ahead.
Before you leave the screen,
'cause Don has a number of questions in the chat
and I just wanted to make sure
that they got answered before we moved on.
Jackie: Of course.
Wendy: So Don asked, "How can you move questions
from a quiz to the library,
in case that you build questions within the quiz?"
I'm not sure if you can see the chat right now, Jackie,
so I'll just read those to you.
If you can see the chat then I ...
Jackie: So ...
At this moment in your organization area,
we cannot move a quiz question
from an individual quiz to the library.
That's why we do recommend to build
all questions in the question library first,
because the question library allows you to move
quiz questions from one quiz to another.
We are working on allowing the functionality
to move quiz questions from a quiz,
such as this module one quiz to the question library.
But right now, at the moment,
we cannot move a quiz question from module one
to the question library.
We can move a question from
the question library to module one.
So Don, I hope that answers your question.
Wendy: And please feel free to interject as well.
We're a small group here.
Don: No, that's all good.
Wendy: Okay, and so the question is,
if you put in a recommended time,
will it warn students that they are over time
or should you use the grace period?
Jackie: So I'll just share with you.
When we click preview,
this is gonna show me what it shows the student.
When the student first enters a quiz,
it will give them a description, the timeframe, the user,
how many attempts and the time allotted.
So they will have an understanding of how much time
they have to take the quiz.
Once the student starts the quiz,
they will see the estimated time at the very top
under the quiz title.
And as they're going through the quiz questions,
there is a clock that will show them how they're doing.
So this is a recommended time limit of 10 minutes.
If the student is approaching the time, this will turn red.
So time taken will turn red for them
if we have given a specified time.
So it does warn them. Yes.
So I hope that answers your question.
Don: Thanks so much.
Wendy: Yeah, the last question is can,
can you set these options, multiple time limits, et cetera
and apply them to all the quizzes at once?
Or do you need to go into each quiz and set the options?
So is this is getting to bulk editing features?
Jackie: It is in the bulk edit feature.
Now the bulk edit feature does not allot for timing.
You can change the attempt that is offered per quiz
and if you hide it.
Don: Okay.
Jackie: In terms of setting the parameters for each quiz,
although with each quiz you need to set
its own settings and permissions.
You could make a template of sorts and then copy.
So a template of sorts means you would create a quiz,
use it as a template and add questions to that quiz,
but the settings will remain.
So I'm not sure if that's a solution for you.
The reason we have that you set settings per quiz
is because we have a number of clients,
higher ed clients in particular
that have a variety of different settings
for a variety of different quizzes.
Wendy: Great, thank you Jackie. I think we're good to go.
Jackie: Good, Excellent.
Now with the question library,
I do recommend with the quiz questions
that you edit them here
and then move them to the appropriate quizzes.
And if you're doing a mass import such as
from an outside source into Brightspace,
we also recommend to upload that CSV
or that import zip package.
We recommend that you do this to the question library
versus an individual quiz
because at the moment we cannot move the quiz questions
back and forth between individual quizzes
versus the library.
We are hoping to make the update so that you can,
but right now I would recommend always building
and always importing into the question library first,
and that way you can import into the variety of quizzes.
So hopefully that is helpful.
Now, I did mention we have quiz questions
that are written response type of questions.
Written response questions are not auto gradable.
So if you have a written response question within your quiz,
you would have to grade it separately.
If you have a combination of written response
and auto graded questions within a quiz,
once you grade manually the written responses in that quiz,
the system will automatically then auto grade
the rest of the quiz and combine the marks
within that quiz.
With a written response type of question within a quiz,
you would go to that quiz
with the written response within it
and you would simply find in the dropdown
or chevron this grade tab.
When you select grade, it brings you to those
written response from the students.
You can see which users have taken
and which attempts they have taken.
You can view the attempts
and you can go to the question
or the written response questions to grade.
Now in here you can grade individual responses
and select the quiz question.
Now this is for our learner
who has taken this written response question.
You could click into the question
and provide the grade value based on their response.
You could give it a score and when you click save,
it will save and be added to Jackie Learner's Response.
Now, if I had multiple students
who had submitted a written response for this quiz,
it will allow me to toggle to the next student
versus clicking back to and going to the quiz dashboard.
So I can just go through all of the students
that have submitted a written response,
grade them all at once.
Now in a written response,
you'll see this is the response the student had provided.
It'll tell you the time that they had given that response.
And here you can add the score.
If you want to provide feedback
to an individual quiz response, written response question,
there is an expand feedback area.
When you click into it, you are given an
HTML Brightspace editor that you can utilize
to provide that individual feedback on that question.
Again, if you have multiple students
who have provided written responses,
you'll see the same screen, you'll just toggle.
You'll find a toggle at the very top right of the screen
so you can toggle to the next student, mark that response
So you can use a combination
of different types of questions.
Now with the question library, as mentioned
you can build a number of different types of questions.
So just to share with you some examples,
once you have built your quiz questions
in the question library it tells you the type, the point,
whether you've allotted a difficulty scale,
whether you've made the quiz question mandatory
and when it was last changed.
So again, the library works as a repository.
If there are multiple faculty members within a course,
you can see who else has modified a particular question.
Now to share with you some of the multimedia options,
I'm just gonna go to this quiz question
and click preview for us.
This quiz question is a multiple select using images.
So students will be able to see the images,
select the responses.
I've also allotted for this
particular quiz question feedback.
So this would be the feedback that students will see
once they've clicked submit.
And this is an example of what the hint would appear
for the student during the quiz.
So you're not just limited to simple text.
You can use multiple different types of quiz type questions.
And again, when you're building each quiz question,
it will prompt you to the next step
or how to build that quiz question properly.
Again, we have multiple select, ordering, fill in the blank,
mathematical, true, false.
Several different types of ways in which you could
build your quiz questions.
Now another key feature with the quizzes
is that at any time you can edit it.
If you edit it after students
have already submitted responses,
it will be edited for those students
who have yet to take it.
With each quiz, again, when you go to the quiz dashboard
and select the dropdown,
you can preview to see how it looks as we just did.
Copy it and place it somewhere else.
Grade whether you need to adjust a grade point value
or whether you need to grade written response,
you can also do something called set up reports.
Now this works alongside of our statistics.
With each quiz you can set up a report
so that you will receive a report
once the students have completed this quiz.
You can give this report a name.
I'll just stick to our quiz three example,
and you can choose what you want
to be seen within this report.
Now you can see class average, bonus questions,
show out of values, question details
in terms of difficulty, private comments,
and some very good statistical information.
Once you've set up your report, you can then choose,
do you want to release the report to yourself
or specifically sends this report on a specific date?
And then you can choose to release the report
to a specific role.
Now I'm viewing this as an administrator,
so I see all roles.
You may only see instructor or facilitator,
read only or TA,
but this just allows you to be able to create
and send a report to your administrator
or an advisor who's monitoring
students within your course.
It's not a necessary thing that you have to create
because we also have another tool called the statistics.
Statistics is a tab within your quiz dashboard.
And when you select the statistics tab
and click into an individual quiz,
it will give you the statistical results of that quiz.
And as I mentioned, you can look at the user statistics.
So how are your users faring with this quiz overall
in terms of grade distribution and class average,
it will show you the individual users
who have taken the quiz and their overall quiz grade.
You can look at question statistics.
So with the question statistics,
how are each question faring within the quiz itself?
And it shows you how the overall average grade was
for this particular quiz question.
I don't have results right now,
but it will show you what we call a standard deviation
discrimination index and point by serial.
If you're not sure what those are,
we do have a link here that will tell you
what these indications are.
Basically these will tell you of the students
that are taking this particular quiz in your course.
Are there students that are weaker or stronger?
Are there certain questions that have
a huge variety between correct and incorrect?
The reason we have these statistics
is to help build better quizzes.
The final tab is the quiz details,
which brings you into each quiz
and what is the percentage of responses
within each quiz question.
Now, if you have a rolling start
or multiple students within a course
that are taking quizzes at different times
due to special access or groups,
you can choose to select question details
from a specific quiz at a specific time.
So start date and end date.
So again, if you have special access students
who have a different timeframe
to take the quiz than you would others,
then you can select a specific report
based on those special access students.
So the quiz question statistics,
again, you can use them, they are available,
they're not required,
but they are available to you to check
and see how things are going.
So I'm just pausing.
We have about 10 minutes left,
so I wanna leave some time for open questions or anything,
comments, thoughts about the quiz tool.
While I'm waiting for any questions that might pop up,
I just wanna come back to, I believe it was Dan's question
or Dawn, sorry, Don,
with the attempts.
So for example, just to review that,
I'm gonna go into this quiz question, quiz one and attempts.
They're in assessment.
For the attempts,
if you choose a specific attempt,
then you can set parameters, you don't necessarily need to.
Students will understand
and see which attempt they're taking.
You can also see how many attempts the students have taken,
how much time they've taken, did they complete the quiz,
and if so, how long it took them in that attempt.
So, and that's within your statistics and in your dashboard.
So I apologize, I hope that answers your question.
-: Do you want another question about exporting?
Jackie: Yeah, go ahead Don.
Don: Sorry, so I saw and played with the import function
in the quiz the question library,
But one way to move things around
would be to export them
and then import them where you want.
I don't see any export button anywhere.
Jackie: So export is only available
when you're building a new quiz from scratch,
if that makes any sense.
You could publish to the LOR,
which will allow you to publish
to your learning objects repository.
But at the moment, the only export
from your question library would be to an
individual quiz within your course.
Now you can copy your question library
from course to course to course.
So if we go to course admin,
and let's say we built a big question library
for an entire department
and we wanna use that question library across
a number of courses.
Let's say we build that question library
in my sandbox or in a different course,
I could go to this tab here
called import export copy components.
This will allow me to search for another offering
or a course that I want to grab
that question library from and place it into a course.
So I would find that course.
Just gonna choose this.
Once I find that course,
I could then go to select components
and export the question library
outside of this course and place it into another course.
So that is one form of export.
If needed, you could export the entire course.
So again, coming back to that master course template
or a course that you've built a library in,
you could export that particular course with the library
entailed here as a package.
So under, again, course admin,
you could export components
or the entire question library from one course to another
by going to import export copy.
Otherwise, the only other way is, again,
if you're in quizzes and you go into a quiz
that you've created from scratch,
you could add or edit questions
and then from here you could import
from the question library.
So there's a roundabout way to export.
I hope that answers your question, John.
Don.
Don: Well, yeah, sort of.
My workflow right now is generally to build questions
in a text editor and import them or export them,
you know, and then play with,
with outside the system to do the editing,
which I often find faster.
And it'd be nice to be able to do that,
but we'll figure out a way.
Jackie: There may be other ways outside of
just the course level.
But again, it's by course,
not by individual tool at this point.
So I'll have to check with our IC teams
to see if they have a solution.
Jen: Jackie, to the course copy,
like choosing specific components.
I don't see library as one of those.
I see quizzes, but not library.
Should I see library in that list?
Jackie: So you're only going to see in the list
what is inside of the course you're copying from.
So for example,
if I copy from the Brightspace resource course, ...
See if I can find it.
Still not there.
Now if there isn't a question library
in that Brightspace resource course
that I'm trying to copy from,
it will not be listed in the components.
So you may not have an existing question library
in the copy component.
Jen: I do, but I'm, maybe I'm just missing it.
Jackie: Is there a name I can utilize or borrow from you?
Jen: Yeah, so the course that has the library,
is that what you mean?
Yeah, it's J-O-S-T-R-M-I-O-O-1.
J-O, sorry, not L.
The 0-0-1 one has a library.
There it is, okay.
So I'm in that course trying to copy it
to a different course, but I'm maybe, is it the opposite?
You go to the course you want to copy to
versus the course you wanna copy from.
Jackie: So I'm currently in my sandbox
and I'm copying from your course library into my course.
Jen: Got it.
Blackboard's the opposite.
You start in the course where the content lives
and then copy it to that the course you want,
the destination course.
So this is flipped.
You start in the course, the destination course.
Jackie: Yeah.
Jen: Okay, got it. Thank you.
Jackie: We like to make things interesting.
-: While we're on the top of the question libraries.
I was noticing in, when I go into a question library
that has questions in it
and I hover and I click on the little import button
in a question library,
I do have an option to browse existing questions.
And I'm wondering if that,
and that does seem to let me copy stuff
into a, copy questions into a library.
Is that right?
Jackie: So you were in import.
-: Versus browse existing questions.
Jackie: Ah yes, the update has happened.
So thank you, Justin.
We are implementing new changes,
so thank you for finding this.
So here you can copy back and forth,
forgive me for giving you misinformation from prior to.
So you can copy from a quiz to the library
or a library to the quiz. Well done.
Yay.
We're making quite a few changes to our quiz tool.
We're updating based on our pie request.
So thank you, Justin.
I'm gonna bring you along with me all the time.
All right, we have two minutes left.
How are we doing.
Wendy: Jackie, this is Wendy.
I'm not quite sure if we, how deep we got
into the learning object repository.
We've kind of alluded to it a couple times and is that,
I'm wondering if you could just give
a little bit more context for what that is.
Jackie: Absolutely.
So the the Learning Object Repository
is a repository specific to your organization.
As administrators, you can choose to build repositories
for whatever you decide.
So you could have a learning object repository
for your health department, your English department,
your maths department.
Then you would give permission to faculty, deans, provost,
whoever you choose to that one repository.
It is a cloud base.
So what that means is we can publish anything
from our Brightspace environment to the cloud.
If we have permission to that particular repository,
we can store it there and save it there,
but we can also bring it back down into our course.
Now the nice thing with the Learning Object Repository
is it is dynamic.
So for example, if you had a health repository
where all your health courses,
course material question libraries are stored,
anyone that has access can bring it
into their course material.
There it is. I clicked too soon.
So for example, I'm in content
and I know that I've created a great component
for my module from my Health Learning Object repository.
I can click add objects from LOR
and this will give me the opportunity
to search what I have access to
and simply drag it from the cloud
and place it into my course.
And if you as an administrator
or one of your lead instructors
decides to make a change to that object or that document,
you would make the change in the LOR and then you could add
that particular object to a course
with whatever version you want to share.
So if it's the newest up to date dynamic version,
you can share that in a course
or you can share a previous version of that document.
So if you're making changes to a lot of documents,
you can make them in the LOR and then as you bring it down
you can decide which version of that document
you want to be seen by the students.
It's basically a library that you can store documents
and you can be very specific with who can see it,
who can interact with the documents and that sort of thing.
But that's a high level overview.
Wendy: And it would also work for quiz questions
'cause when you were in the,
when you were in the quiz tool
and you were creating a question, it said publish to LOR.
Jackie: Yes, so you could publish
a question library there.
The way it works is it goes to the cloud as a link.
And when you have it in the LOR,
you can change a quiz question there.
Anywhere that that quiz question
has been shared in the environment,
it will be automatically dynamically updated.
So the LOR is a great space for something
like a question library
where the questions can be updated in the LOR,
and it doesn't affect any individual course question library
until the update is made in the LOR.
So hopefully that makes sense.
Wendy: Thank you.
-: Yeah, you could create a learning object repository
just for quiz libraries,
but we typically do it by topic matter,
subject by department so that only certain users
can have access to that.
But there's many options and possibilities
with the Learning Object repository.
It basically takes the pressure off of your Brightspace
environment because it's in the cloud.
Wendy: Any final questions for Jackie before
we wrap up this afternoon's session?
All right, well thank you so much for your time.
We appreciate you getting a head start
on learning about the quiz tool.
We will be following up with some chances for,
for even more in depth exploration
on the first week of October
and we'll be sending out
some more information about that to y'all.
But in the meantime, thank you again for attending
and Jackie, thank you for another wonderful session.
Jackie: Thanks for having me.