the individual being annotated is alone in the home environment; no other persons are present in the home
alone in room
the person being annotated is alone in a room where no other person is present; however, one or more people are present in other rooms or spaces in the home
applying makeup
putting substances on the face or neck to visibly enhance or alter the appearance of the individual
basement {room location}
a room or distinct space located below the ground level of a house that an individual typically does not use as a bedroom, living room, bathroom, or any other living space.
bathing or showering*
with the body positioned in a bathtub or shower, water is applied to the body along with other products to clean the body
bathroom {room location}
a room or distinct space that contains a toilet, bath/shower, and/or sink.
bedroom {room location}
a room or distinct space that an individual uses primarily to sleep.
brushing or styling hair
using a brush, comb, fingers or other implements to arrange the hair on one's head; may involve curlers, clips, straightening irons or similar devices; may involve the application of spray, gel or other chemical products to the hair
cleaning [miscellaneous]
any activity related to cleaning not otherwise listed
cooking or warming food
handling, manipulating, or interacting with a device that generates heat in order to increase the temperature of an edible item (e.g., turning on a stove, putting items in an oven, setting timer on a microwave)
crouching/kneeling {posture}
the individual is in a stooping position in which his or her knees are either touching the ground or bent
engaging in whole body movement characterized by rhythmic motions, typically in a varied sequence rather than repetitive. Often accompanied by music.
removing the excess particles left on used or dirty items (generally cooking implements or tableware). Most often involves the kitchen sink, dishwasher, or a cleaning basin.
dishwashing [background]
a dishwashing appliance has been loaded with kitchen utensils and other service items and has activated. This activity should remain current until the participant removes the dishes from the appliance, or there is clear evidence (such as an audible signal) that the cleaning cycle is completed. In the absence of these cues, this label may be closed after 90 minutes have elapse.
dining area {room location}
a room or distinct space where individuals typically consume food. If the area where an individual consumes food is not distinctly separated from the space or room where food is prepared, then the entire area is labeled as a kitchen rather than a dining area.
dishwashing [miscellaneous]
any activity related to cleaning dishes not otherwise listed
doing laundry
performing actions to clean clothing and domestic textiles, such as tablecloths, bedding, towels, etc. These actions include adding/removing clothes from either the washing machine or drier or adding cleaning solution to clothes or machine.
doing laundry [background]
washing machine or drier is powered on and running without the active attention of the participant.
having prepared a vessel with potable liquid, the vessel is placed in contact with the lips, so to facilitate ingestion of the liquid; having previously drunk, the vessel may be held away from the face or placed aside (usually within arms reach) and returned to drinking position after a reasonable period of time; the act of drinking should be considered active until the vessel has been rendered empty or there is clear evidence that the individual will not resume drinking shortly
drying hair
using a blow dryer or towel or other object to remove moisture from hair
holding, consuming by bringing (generally from a serving vessel) to the mouth, and chewing food items; typically follows some form of meal preparation; placing food items to aside after having recently consumed them and returning to actively eating within a reasonable period of time
eating [miscellaneous]
any activity related to eating not otherwise listed
endurance training
High pace activity often rhythmic and repetitive that occurs for a significant duration of time (commonly between 15 minutes and 1 hour). Mechanized apparatuses (treadmills, elliptical machines, or rowing machines) are often employed in this activity.
entering the home {room location}
an individual returns to the premises of the home from any outside location, after having left for a duration of time that typically lasts longer than 15 minutes. I.e., if an individual steps outside briefly in order to take out the trash and promptly returns to the home, this label shall not be applied.
performing bodily movement, typically repetitive, and without apparent instrumental objective. Generally falls into three categories: strength, flexibility, and endurance training.
flexibility training
Contorting or maneuvering the body into a series of abnormal positions that are held for a duration usually ranging between 10 seconds and two minutes. Stretchable bands, mats, and inflatable balls are objects often used in this activity.
garage {room location}
a room or space that is typically used for storing vehicles or objects rather than as a living space. Typically, this area is separate from all other rooms.
getting dressed
putting clothes or accessories on.
getting ready to sleep
performing activities associated with sleeping such as brushing teeth, putting on bedclothes, turning off lights around the home, etc.
getting undressed
taking clothes or accessories off.
grooming {category}
performing tasks to alter bodily appearance such as shaving, styling hair, etc.
grooming [miscellaneous]
any activity related to grooming not otherwise included in the current ontology. May include tasks intended to alter bodily appearance such as shaving, styling hair, getting dressed, etc. May also include activities ancillary to the above such as putting on a watch, sunglasses, or preparing for activities outside the home.
hallway {room location}
an interior passageway or corridor onto which rooms open; an entrance hall.
healthcare [category]
performing actions that prevent, mediate, or treat health related issues. Common examples are treating an injury or ingesting medication.
healthcare [miscellaneous]
any activity related to healthcare not otherwise listed
home management [miscellaneous]
any activity related to home management not otherwise listed
performing activities which maintain personal cleanliness such as cleaning teeth, washing hands/face, bathing, or toileting.
hygiene [miscellaneous]
any action associated with hygiene not otherwise listed
information [miscellaneous]
any activity related to information not otherwise listed
injury treatment
performing activities related to healing an injury or preventing further damage. activities can include cleaning/bandaging a wound, icing a sprain, applying eyedrops or ointment etc.
using a heat-producing handheld appliance to flatten articles of clothing or other fabrics through the application of force against the article on a flat surface.
kitchen {room location}
a room or distinct space that is predominantly used for the preparation and/or storage of food. this location typically contains a refrigerator, cooking supplies, dishes, etc.
laundry [miscellaneous]
any activity related to laundry not otherwise listed
leaving the home {room location}
an individual leaves the premises of the home to go to any outside location for a duration of time that typically lasts longer than 15 minutes. I.e., if an individual steps outside briefly in order to take out the trash and promptly returns to the home, this label shall not be applied.
leisure [miscellaneous]
any activity related to leisure not otherwise listed (e.g. playing a game)
listening to music/radio/audio content [background]
spoken word or musical content is emanating from a device other than a television or 2-way communication device. May be inferred when the individual being annotated is wearing headphones, but not engaging in conversation. using a remote control, portable music player, stereo system or computer interface to change audible aspects of the sounds emanating from an audio playback device, such as changing the station/track/volume currently played.
living room {room location}
a room or distinct space that an individual uses predominantly for social, entertainment, and/or lounging purposes. this area may also be is used for work-related purposes, although this is not typically its primary function. this area typically contains a couch, loveseat, armchairs, or other seating where individuals can rest..
lying/reclining {posture}
the individual is in a posture in which the body is predominantly horizontal and supported along its length by the surface underneath
making the bed
rearranging the sheets, pillows, and other objects involved in sleeping into orderly, generally consistent, positions on the bed.
using an implement comprising a sponge or a bundle of thick loose strings attached to a handle to wipe floors. Requires application of liquid (typically water mixed with soap) used for wiping floors or other surfaces.
participant enters a short duration of sleep, generally lasting less than one hour. Can occur while sitting or laying down.
not alone
another person is in the same room or space as the individual being annotated.
office {room location}
a room or distinct space where an individual predominantly engages in work-related activities. Unlike a bedroom, an individual does not typically use this space to sleep.
oral hygiene
using a toothbrush, mouthwash, floss, or similar tool to clean teeth. Most commonly occurs near a sink with repetitive back-and-fourth motions with the hands to the mouth.
picking up, moving, arranging or putting away items in the home. Often involves taking many items from multiple locations and placing them in a single location.
out of view {room location}
the participant is known to be inside the home but is not presently visible on any functional camera view; this label is applied when the camera is broken or turned off. When the participant is in a room where no camera is present, this label shall be applied except in the circumstances where another room's camera captures the participant. This label shall not be applied when a participant is only partially obstructed from view.
outside {room location}
the individual being annotated is not within the home.
pet activity
interacting with a domesticated animal, or any activity to service the animal’s needs (e.g., preparing food, playing with an animal toy, brushing)
preparing a drink
engaging in an action to facilitate human consumption of liquid matter (e.g., retrieving milk container from refrigerator, using a bottle opener, placing ice cubes in a glass, changing filter in coffee maker).
preparing a meal [background]
a device that generates heat in order to increase the temperature of an edible item is powered on, but participant is not actively controlling the device (e.g., boiling water on stove, preheating oven, waiting to remove cooked item from microwave)
preparing food [miscellaneous]
any action related to food preparation not otherwise listed
putting away laundry
folding, hanging, or otherwise placing clothing and domestic textiles, such as tablecloths, bedding, towels, etc. into storage locations
reading printed material
interacting with paper-based materials (e.g., books, magazines, letters, pamphlets) in such a manner where it is evident that attention is directed at the textual or pictorial content of the item
eyes opened in a posture not requiring conscious muscle support (e.g., lying down, reclined sitting) without moving bodily appendages. Background activities may continue during relaxation.
moving the arm or wrist in a rapid, repetitive motion so as to clean a surface through the application of force, and often an abrasive material and fluid. Scouring pads, sponges, brushes, towels and similar items are often used in this activity. Similar to wiping, but with shorter strokes and greater intensity
searching for an item
opening drawers, cabinets, etc or moving around the home to uncover or acquire an item.
applying shaving cream, picking up and using a razor or other device to remove hair from skin
sitting {posture}
a position in which the individual's back and neck are predominantly vertical, and his or her weight is not predominantly supported using legs.
sleeping [miscellaneous]
any action related to sleeping not otherwise listed
sleeping deeply
participant is laying down with eyes closed for an extended duration. Typically occurs from the evening into morning.
upright {posture}
includes standing, walking, running, leaning, or bending over. In this posture, the individual's weight is typically support by his or her feet and the knees are not significantly bent.
strength training
Performing repetitive motions typically clustered in groups of 5-50 repetitions at a moderate to slow pace. Most commonly involves lifting or pressing objects (such as free weights, stretchable bands) or the body itself.
performing actions associated with the deployment, upkeep, or maintenance of study related materials. Common examples are replacing batteries to sensors, adjusting cameras, or maintaining kiosks.
manipulating an instrument comprising a handle (long or short) and a brush in repetitive arching motions, wherein the application of the brush to the floor is likely to cause debris to move in a desired direction. using long linear applications of a "push broom" to the floor in a manner that will cause debris to be consolidated in a small area. using a handled device with a dust collecting head (e.g. "Swiffer") in panning motions to aggregate debris from a floor. using a short-handled "dust broom" and pan to remove debris from the floor and transfer to a receptacle
taking medication or vitamins
engaging in activity related to the ingestion of medicine orally or nasally. Subtasks include opening/handling pill containers, preparing/drinking water, swallowing pills, etc.
taking out trash
carrying solid waste items from waste bins to other storage location.
talking on a phone
Speaking or listening to another person using a mobile or stationary telecommunications device. Actions associated with this activity include: picking up or activating the device (such as a wearable headset) and placed to the ear communication device is put away, or other action implies conversation has ended (e.g., “bye-bye”, button pressed, etc.)
talking to someone in person
speaking or listening to another person(s) while in the same location as they are
throwing something away
placing, tossing, brushing an item into a receptacle designated for the disposal of solid waste (e.g. trash can, trash compactor, toilet)
expelling bodily waste. * this is a private action and annotation will be determined either using auditory or sensor data.
using a computer
while positioned in front of device, subject interacts with a laptop or desktop computer by focusing gaze at screen, using a keybord, mouse, trackpad or similar device
using mobile phone/pda/mp3 player (other than talking)
Using or manipulating a mobile phone or similar handheld computing device other than for engaging in spoken conversation with a person not immediately co-located. May include syncing or charging the device or using it as a medium for an activity (e.g. iphone bowling).
using a powered device to remove debris from a floor through the application of a suction component to the surface.
visitor present in home
a person who is not a resident of the home, and not a regular participant in this study, is in the home. This individual should have signed a Guest Consent Form for participation in this research
waking up for the day
rising from a long duration of sleep and not returning to a deep sleep for a significant portion of the day
washer/dryer on [background]
washing machine or drier is powered on and running without direct attention paid to it
washing face
applying water to the face either directly or on an object (e.g. towel). Often includes the application of a cleaning agent such as soap.
washing hands
placing hands into water or applying liquid sanitizer or sanitizing wipe to the hands and rubbing it in.
watching tv/movie/video content
the individual is present when/where a television is powered on, and his or her visual gaze is directed toward the television. TV is turned on either manually or by manipulating a remote control device, or individual enters proximity of television and directs their gaze toward it. Using a remote control, DVD player, on-set interface, etc. to change channels, start a movie, change the volume
watching tv/movie/video content [background]
the participant is present in the room where a television is powered on, and his or her visual gaze is not directed toward the television or is engaged in another activity. *Annotator discretion can be used to switch between foreground and background watching depending on frequency of views toward the TV
moving the arm or wrist in a gentle linear or arcing motion so as to remove debris or residue from a surface. Typically involves a soft cloth-like material for picking up or absorbing unwanted contaminants. Fluid (usually sprayed on the surface) may be involved.
working on a hobby
using/gathering/putting away materials involved in an activity not otherwise specified, and assumed to be recreational in nature (e.g., handicrafts, collecting, painting, etc.)
using a pen, pencil, marker, chalk, or other implement to produce characters on a surface
engaging in activities related to the upkeep and management of outdoor spaces, especially those involving plantlife such as lawns or gardens