ROBOY INITIATIVE you should really try to try this!
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Roboy-made Lighthouse Sensor
60Hz, 1mm accuracy,
external object tracking
ROBOY INITIATIVE
you should really try to try this!
24.04.2018
Information Event WS1718
Rafael Hostettler, rh@roboy.org
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
ROBOY.ORG
OUR VISION
a robot as good as the human body
* Comparable dexterity, sensor acuity,
softness, flexibility, strength and
ability to self-repair ROBOY.ORG
THE BEGINNING OF THE STORY
robots like the human body
2007 2011
ROBOY.ORG
Cronos, 2007 ECCE Design Study, 2011
A STEP TOWARDS ROBOY
from art to engineering
2012
ROBOY.ORG
ECCEROBOT ProjectROBOY JUNIOR
the first of its kind
2013
ROBOY.ORGROBOY 2.0
from friendly to good
2018
ROBOY.ORGHOW TO BUILD A HUMANOID
components of magic
TEAM «PROCESS» TECHNOLOGY
ROBOY.ORGACHIEVING THE VISION
by creating a magical team
TUM’s BEST STUDENTS guided by PhDs IN ROBOTICS
COMPUTER ELECTRICAL
ROBOTICS SCIENCE ENGINEERING
MECHANICAL
ENGINEERING ECONOMICS
ROBOY.ORGROBOY’S GUILDS
competency clustered
Mechatronics Middleware
Building the body Roboy’s
of Roboy 2.0 nervous system &
tracking
Control Cognition
Making Roboy Making Roboy
move, walk, reach intelligent
Agile Growth
Bringing structure AR/VR, Simulation,
into chaos Games, Design & Crazy
ROBOY.ORGPROJECT TEAMS NOT SILOS
a compact & achievable goal
Team: Alpha to Omega
Mission: Roboy 2.0 Mechatronic Bughunting
ROBOY.ORGHOW TO BUILD A HUMANOID
components of magic
TEAM «PROCESS» TECHNOLOGY
MIND SET
ROBOY.ORGAGILE IS NOT CHAOS
it’s a mindset embracing change
ROBOY.ORGVERTICLEAN
façade-cleaning robot
ROBOY.ORGBEERNOW
social beer sharing
ROBOY.ORGWE’R’CARS
Mario-cart gone “real”
ROBOY.ORGROBOY 2.0
DO
getting started
ROBOY.ORGROBOY 2.0
DO
getting started
9 Muscles
ROBOY.ORGROBOY 2.0
DO
getting started
Many Cables
ROBOY.ORGROBOY 2.0
DO
getting started
Many Sensors
ROBOY.ORGHOW TO BUILD A HUMANOID
components of magic
TEAM «PROCESS» TECHNOLOGY
MIND SET
ROBOY.ORGMECHATRONICS
what makes robots robots
ROBOY.ORGROBOTS BUILT ALONG THE WAY
parts of humanoids
ROBOY.ORGROBOY 2.0
the second generation
ROBOY.ORG
300N MuscleAGILE SYSTEM ARCHITECTURE
enabling co-evolution
Backbone Arm
Backbone Head
Backbone Spine
Spine Legs
Arm Hand
ROBOY.ORGROBOY HAND
cat proof & agile
ROBOY.ORG
300N MuscleMYO BRICK
the force is strong in them
ROBOY.ORGGENERATIVE DESIGN
design by requirements
ROBOY.ORGGENERATIVE DESIGN
getting functional fast
1 week from idea to robot
ROBOY.ORGMIDDLEWARE
the spark of life
Hardware
MAGIC
Software
ROBOY.ORGPOWERFUL MIDDLEWARE
fast, versatile, magical
ROBOY.ORGSENSING
making roboy feel itself
ROBOY.ORGLIGHTHOUSE TRACKING
virtual reality repurposed
• Lighthouses emit infrared pulses
• Custom sensors are connected to the FPGA Lighthouses &
controllers
• Position is calculated based on durations between pulses
FPGA
Custom sensors
ROBOY.ORGPRESSURE SENSITIVE SKIN
2D shadow projections
ROBOY.ORGCONTROL
actually doing stuff
ROBOY.ORGMATH CONTROL
doing stuff provably
ROBOY.ORGDEP CONTROL
self exploring networks
ROBOY.ORGHILL-MUSCLE CONTROL
making muscles real
Myorobotics
Muscle Experiments
ROBOY.ORGNIPS 2018: AI FOR PROSTHETICS CHALLENGE
making muscles real
2017 2018
ROBOY.ORGNIPS 2018: AI FOR PROSTHETICS CHALLENGE
making muscles real
ROBOY NIPS HACK KICKOFF WEEK
WE Food, Drinks, Computational Power (DGX-1)
YOU Time, RNN Know-How
WHEN 13.8 – 17.8.
MORE www.roboy.org/nips < apply!
? https://www.crowdai.org/challenges/nips-
2018-ai-for-prosthetics-challenge
SUPPORT
2018 2019
ROBOY.ORGCOGNITION
cogito ergo sum
ROBOY.ORGVISION
I see you
• DLIB: Facial landmarks and face
recognition
• Joint Face Detection and Alignment
using Multi-task Cascaded
Convolutional Networks
• You Only Look Once: Unified, Real-
Time Object Detection
• FaceNet: A Unified Embedding for
Face Recognition and Clustering
ROBOY.ORGDIALOG MANAGER
talking with robots
ROBOY.ORGGAMES
it’s fun to play
ROBOY.ORGHOW TO BUILD A HUMANOID
components of magic
TEAM «PROCESS» TECHNOLOGY
MIND SET
ROBOY.ORGBUILDING IS NOT ENOUGH
it’s an initiative that transforms society
BE FRIENDLY. Sponsoring
Collaborations
THE CORE PRINCIPLE Fairs
OF TECHIES & ETHICS Events
BY ROBOY & LUCY.
Roboy at School
Roboy Project
Roboy & Lucy
ROBOY.ORG
Roboy InitativeROBOY’S SPONSORS
materials to make robots real
ROBOY.ORGFAIRS
showing off roboy to the world
ROBOY.ORGHUMAN BRAIN PROJECT
providing bodies for simulated brains
ROBOY.ORGRESEARCH COLLABORATIONS
making science happen
And many more: ETH Zurich, EPFL, KTH, IIT, Disney Research, Stanford, CMU, MIT, Harvard, KIT, Aldebaran, Poitiers, JSK, ...
ROBOY.ORGRESEARCH TRAVEL
collaborate, travel and having fun
09/2018: North (and a bit west)
ROBOY.ORGHIGH PROFILE EVENTS
explaining robotics to executives
javascript:;
ROBOY.ORGROBOY AT SCHOOL
igniting the young ones
• §
ROBOY.ORGwww.roboy.org
ROBOY.ORGwww.roboy.org
www.roboy.org/
lucy
ROBOY.ORGROBOY & LUCY
EXHIBITIONS roboy.org/lucy
Roboy & R&L – MULTIMEDIA
History and Outlook
Roboy 2.0 Virtual & Augmented /
Mixed Reality
Learning Experiences
CODING
Makeathons & MERCHANDISING
Hackathons –
Build and program Children‘s books
Roboys & Hardware
(Roboy Kit,
Mr. Big, Checker...)
www.roboy.org
MULTIPLIERS www.roboy.org/ VIDEOS
lucy
Teacher education on Tutorials
AI & Ethics, & Stories of and
Digitalisation with R&L
EVENTS
ROBOY.ORG
© ROBOY & LUCY, Mai 2017 www.roboy.org/Lucy
Mobile Exhibition & Interactive ExperiencesGETTING TO THE BIG VISION
by achieving many small ones Feb, 2023
ROBOY
BUILDS
Feb, 2020
March, 9, 2013 ROBOY
ROBOY THE
BIRTH OF ROBOY April, 2018 CHEF Feb, 2024
September, 2015 ROBOY 2.0 MARS
ROBOY TEAM Aug, 2018 Aug, 2020 ROBOY
FOUNDATION ROBOY DJ DR. ROBOY
Roboy on Tour From Roboy to Modular Toolkit 2018 2020 2022 2024
2013 2015 2016 2017 2019 2021 2023
April, 2016
Aug, 2019 Feb, 2022
ROBOY JOINS
ROBOY SELLS ROBOY THE
HUMAN BRAIN
ICE CREAM CARPENTER
PROJECT
Feb, 2019 Feb, 2021
ROBOY ROBOY THE
RIKSCHA WAITER ROBOY.ORGWHERE WE ALMOST ARE NOW
and what you’ll seeing tonight
I can play xylophone in VR
April, 2018
and Roboy 2.0 will be
ROBOY 2.0
playing the same tunes on
Aug, 2018
a real xylophone
ROBOY DJ
2018 2020
2019
Aug, 2019
ROBOY SELLS
ICE CREAM
Feb, 2019
ROBOY
RIKSCHA ROBOY.ORGWHERE WE WILL BE
and what you will contribute to
April, 2018
ROBOY 2.0
Aug, 2018
ROBOY DJ
2018 2020
2019
Aug, 2019
You can open Telegram, ROBOY SELLS
ICE CREAM
write Roboy on Telegram
and get him to pick you up
Feb, 2019
from Ubahn and drive you
ROBOY
to the office. RIKSCHA ROBOY.ORGSHUT UP AND TAKE MY TIME
how to become a roboyan
• WANT TO BE PART OF ALL OF THIS?
ROBOY.ORGPOSITIONS & CREDITS
how to help roboy
Positions (€) ECTS – Roboy Student Team
• Team Orga • Lab Course (IN, RCI)
• Marketing • Seminar (IN, RCI)
• Sales / Key Account Management • Forschungspraxis (EE)
• Art & Design Orga • Project Studies (BWL)
• Roboy & Lucy • Thesis (MEng)
• Writing Proposals • Thesis (rest, 4 slots)
• IDP (IN, limited)
❤️ & Experience
• Roboy Angel ROBOY.ORGROBOY AS SEMINAR
special credits for special people
• Agile Coach (max. 5) – 2 teams each
– Very organised people only
• Roboy’s Research Review(max. 5)
– 2 minute Robot Papers
• Roboy’s Research Team (max. 5)
– Research state of the art
ROBOY.ORGAGILE COACH
bringing order into chaos
ROBOY.ORGROBOY.ORG
ROBOY’S RESEARCH TEAM
building foundations to rest on
• Get 1 topic
• Get 5 papers
• Find 45 more
• Select 10
• Read 10
• Write 10 pages how to
apply them in Roboy
ROBOY.ORGROBOY TEAM’S STRUCTURE
we hate overhead, so we’re agile & efficient
Angels
In love with Roboy now lead
& forever
Guilds Teams
Group of people with Group of people working
same skills on partial vision
You
Will become part of
are part of
1 guild & 1 team
ROBOY.ORGROBOY’S ANGELS
here to help you help roboy
Raf Alona Simon Luis Jürgen
GUARDIAN COGNITION CONTROL MIDDLEWARE MECHATRONICS
Cic & Egor Kris Alex Nikita
GROWTH BUSINESS TECH DIALOG SYSTEM
ROBOY.ORGROBOY’S GUILDS
competency clustered
Mechatronics Middleware
Building the body Roboy’s
of Roboy 2.0 nervous system &
tracking
Control Cognition
Making Roboy Making Roboy
move, walk, reach intelligent
Agile Growth
Bringing structure AR/VR, Simulation,
into chaos Games, Design & Crazy
ROBOY.ORGTHIS IS YOUR TEAM
how you will work
You
Guild Team mate
Lead
Your Team’s Vision
Agile
Team mate
Coach
Team mate
ROBOY.ORGYou
THESE ARE YOUR GUIDES Guild
Lead
Not You
helping you get there Agile
Not You
Coach
(Not You)
Guild Agile
Lead Coach
Knows the tech by heart Knows the processes
Knows the tools Knows Jira & Confluence
Answers technical questions Answers when/what questions
Is with Roboy for >1 year Potentially as fresh as you
ROBOY.ORGOUR TOOLS
bringing order into chaos
ROBOY ROOM
Access & Courses
ROBOY.ORGWHAT WE WORK WITH
ROBOY.ORGPREREQUIREMENTS
every roboticists should know…
One of:
• Object Oriented Programming (C++, Python)
• ROS
• Gazebo
• Unity
• CAD (Autodesk Fusion360)
+ Linux
+ We will do workshops in:
ROS, GIT, KiCAD, CI (Jenkins), Fusion 360
ROBOY.ORGGRADING
putting numbers to awesomeness
Sym Item Description Mark Weight Categories
Q Work quality Assessment of the quality of the project solution (in
terms of usability, originality). 60% w. D are graded in %.
Code/project documentation quality on
D Documentation Confluence. 60% w. Q
Final Grade:
Complete a brief weekly report (on Confluence),
W Weekly report checked by scrum master. 10%
Writing about your work in a blog post 5-4*sqrt(
B Blog about your work 5%
0.6*D*Q+
Mid-term and final presentations are assessed.
P1, Presentation quality Feedback will be provided based on clarity of 5% Mid-term 0.1*W+
P2 presentation, structure and time.
10% Final 0.05*B+
T In-team assessment At the end of the semester, the section “my
10% 0.05*P1+0.1*P2+
contribution” has to be completed, after agreeing
with all team members. This section should contain 0.1*T)
a brief summary of what you did, information on
the amount of work you have done in the team and
how you contributed.
ROBOY.ORGORGANISATION
schedule throughout the semester
Release 3.0.1 Release 3.5.0 Release 4.0.0
ROBOY.ORGORGANISATION
schedule throughout the semester
Lab Course Team Meeting Sprints Guild Meeting
12+ hours/week weekly 2-3 weeks monthly
ROBOY.ORGAPPLICATION PROCESS
how to actually become a roboyan
Through Matching System (IN, easier)
•Why you?
•10’ face
•What to face You’re in!
done? Let’s get
•Slots in 2 started
•How dates
Help?
Apply Interview Selection
by 4.7.2018 5.7. – 10.7.2018 1.8.2018
ROBOY.ORGAPPLICATION PROCESS
how to actually become a roboyan
After Matching (everyone else, tougher)
•Why you?
•15’ face
•What to face You’re in!
done? Let’s get
•Slots in 2 started!
•How dates
Help?
Apply Interview Selection
by 1.10.2018 8.-11.10.2018 12.10.2018
ROBOY.ORGWHY YOU SHOULD LIVE FOR ROBOY
after roboy will be a better you
Professional tools & workflows
Soft-skills & project management
Apply your theoretical knowledge community
Work with cutting-edge hard- & Only student team with a DJ
software – it’s all there or we buy it. Regular social events & parties
skills Free beer, slippers & a shirt
Find an awesome job or internship
Talk to corporates at events
Go to the most exciting labs
network
ROBOY.ORGAND THEN?
collect the certificate, add it to your CV
ROBOY.ORGTHAT’S IT see you next semester – or later this presentation & more: www.roboy.org/join ROBOY.ORG
You can also read
