Digital Omniscience Dashboard

D.O.D

Select Subject

Name: Fisnik
Age: 21

About D.O.D

This project aims to expose the data collected by Surveillance Capitalism. Shoshana Zuboff, the main theorist in the subject, argues in order for Surveillance Capitalism to work, there must be high economies of scale – meaning a vast amount of data needs to be collected, and high economies of scope – there must be a large variety of data types. Having these two key resources allows data algorithms to predict user's behaviour and therefore promote relevant things.

The interface I have designed will place you in the 'shoes' of these data algorithms in our devices. The data is broken down into these categories: wearables, microphone, activity and camera. These represent the sensors around the subject's life which constantly collect data. In the camera category you will find data in the form of images taken from sensors such as smartphones and surveillance cameras. In the microphone category, there are snippets of sound files taken from videos recorded by the user, and recordings taken from voice assistants.

I want to make apparent through this interface the high levels of deception in these algorithms, deeply designed to be hidden from us. Take a look through the available data, combine them and submit inferences based off the subject's digital activity, physical activity, facial expressions and whatever else you can infer.

To learn more about the project, visit my portfolio.

Loading Data...

How to use the dashboard

This dashboard shows four categorise of data. Your first task is to make an inference about the subject from the available data.

Have a look around the dashboard, select pieces of data you find interesting. When you're ready, click the wiggling ‘Make an inference’ button on the top right. The data you clicked will appear again to remind you whilst you make make your inference.

1) Look through the available data.

2) As you view the data, select pieces you think you may be able to use to make an inference.

3) When you're done selecting data, click on the 'Make an Inference' button on the top right.

4) Make your inference about the subject.

fisnik:DATA:overview

Data:sensor:

WEARABLES

Smart Watch Data, shows averages calculated from 1 month period.

Average Weekly Stress

Average Heart Rate

Daily broken down heart rate

Sleep

Average
Sleep Efficiency

82%

Average
Bed Time

00:58

Average
Sleep Time

Behavioural analysis of selected data

Data:sensor:

BEHAVIOUR

Click on a piece of data to begin analysis.

From:

VOICE ASSISTANT

Selected:

MIC DATA

Behvaiours Detected:

Excitement
Confusion

Behvaiour Detected:

Right

Detected Transcript:

“gwyneth paltrows children”

Data:sensor:

MICROPHONE

Data taken from devices which record audio

Videos

Voice recordings from video clips.

Google

Voice recordings from voice assistants.

Sound from: Recorded Video.

Sound from: Google Assistant

Sound from: Recorded Video.

Sound from: Google Assistant

Data:sensor:

CAMERA

All available data from camera sensors

All available data from camera sensors.

Filter Data:

Social Media

CCTV

Images

Videos

All

Posted on Instagram

Data:sensor:

ACTIVITY

Subject's
Activity Data.

Apps

Average of most used apps by subject within a month period.

Location

Most visited locations by subject

Instagram: 209

Twitter: 166

Youtube: 65

Snapchat: 47

Messenger: 41

Whatsapp: 22

Facebook: 21

Photos: 20

BBC News: 19

Gmail: 19

Maps: 16

Spotify: 15

Outlook: 12

Amazon: 10

Linkedin: 10

Citymapper: 10

Google Home: 9

Monzo: 9

Dropbox: 5

Netflix: 5

Viber: 4

Slack: 3

Google Drive: 2

Tiktok: 2

Uber: 1