Confessions of a researchaholic

November 4, 2019

Creation is a dialog

Filed under: Real — liyiwei @ 9:27 pm
Tags: , ,

About a decade ago, Evvia felt like a place for old people to me.
It was livelier a few days ago when I visited again.
I wondered what has changed and realized maybe I got old.

View this post on Instagram

Grill chef – oil painting #adobefresco

A post shared by Kublai (@kub1ai) on

Artistic creation and scientific research share many similarities, such as picking the right subject/topic, and trusting the iterative process.
When I start a research or drawing, I usually do not have a very concrete idea of what I want to do, at least for more innovative projects. (If I can see a clear road-map from the beginning, the project is incremental.)
Just start doing something, and the process will guide me.

View this post on Instagram

Stove chefs – watercolor #adobefresco

A post shared by Kublai (@kub1ai) on

I did not really want to draw this one but felt compelled to finish the third of the Evvia series.

View this post on Instagram

Bar area – narinder pencil sketch #procreate

A post shared by Kublai (@kub1ai) on

November 1, 2019

Deadline ruining your holiday?

Filed under: Real — liyiwei @ 4:24 pm
Tags: , ,

I never understand why people want to complain about how deadlines ruin (their specific) holidays.
Everyone is free to finish the job before the holiday even if the official deadline is afterwards.

I remember Hugues Hoppe told me that he usually had a complete draft of his submissions before late December, and in one instance he didn’t even touch the paper between X’mas and the January deadline.

Nowadays, one can submit to ToG anytime and still present in SIGGRAPH; I am not sure what is the real difference. And there are other related venues like CHI or CVPR.

Personally, SIGGRAPH crunch is kinda fun for me, so I won’t mind one way or another.

September 20, 2019

Provisional patent application

Filed under: Real — liyiwei @ 3:09 pm
Tags: ,

A provisional patent is worth considering, if your institution does not want to file a real (non-provisional) patent for your project.
It has much lower cost and much faster process than a formal patent filing, while offers similar protection in terms of public disclosure date.
There is a one-year period for a provisional patent, during which you can evaluate whether it is worthwhile to file a real patent.

For example, I filed a provisional patent (out of my own pocket) for the autocomplete hand-drawn animation project, which has gathered a lot of interests and yet it is tricky to file a patent due to the institutions involved (University of Hong Kong, University of Tokyo, Microsoft Research).
However, after one year, Jun, the first author and builder of the system, did not manage to produce a sharable prototype, so I just let the provisional patent expire. If he had a prototype with enough product interests, I would proceed filing an official patent.

August 23, 2019

SIGGRAPHickness

Filed under: Real — liyiwei @ 4:56 pm
Tags: ,

A co-author added a typo “SIGGRAPHickness” into a bib entry today; I guess it means sickness induced by working too hard for SIGGRAPH.
🙂

August 18, 2019

My idea of a mixed reality device

Filed under: Real — liyiwei @ 5:03 pm
Tags:

A single device that bridges VR and AR by displaying synthetic graphics seamlessly with or without the real environment, captured by some sensor/camera without requiring optical seethrough, consumes low power, tracks eye gazes (e.g., for foveation) and locations (e.g., for overlaying geo information).

These can already be achieved programmatically on some smart phones; glasses can reach a subset of users (e.g., those already wearing prescription glasses or requiring hands-free working conditions).

Disclaimer: this is my personal opinion, conceived and written on my personal computer outside Adobe working hours.

August 4, 2019

SIGGRAPH 2019

Filed under: Real — liyiwei @ 4:20 pm
Tags: ,

I spent most of my time in the experience hall with the workshops and demos.
I did not attend a single paper session.
I could socialize with the paper authors a bit more, but I bump into some of them in the parties.
The more conferences I have attended, the more I believe the value of hands-on experience in trying out new things and interacting with different people than just passively listening to talks (most of which are recorded for later viewing, except for the movie production sessions).

For the entire week (from July 25 to 31) I had dinners in various parties (SIGGRAPH Asia technical papers committee meeting and SIGGRAPH conference).

\paragraph{Sunday}

The cybersickness workshop sounds relevant to my research. When I went there, I saw a presenter talking over slides full of dense texts and felt sickness without HMD already. So I left.

I know about the turtle visual programming, but this is the first time I tried hands-on with the Turtle-Stitch embroidery machine.
Basically, you control the turtle (pointer) movement via blocks and write a program by chaining the actions together. Warnings will show if any step may cause manufacturing issues, such as large strides. The program can be saved to a weaving machine to produce an embroidery.

View this post on Instagram

TurtleStitch embroidery – wow smiley face

A post shared by Kublai (@kub1ai) on

The VR/AR magic session much more interesting with several talks from the industry.
For stationary players, locomotion in games can be achieved via hand controllers for speed and turn.
Synthetic blinks in the rendering can be added for teleportation and turn without eye tracking.
Magic Leap presents Mica, which looks very realistic during the presentation which made me wonder if the company is considering pivoting towards content creation if the hardware does not pan out.
I made a mental note to try the demo to see how opaque the graphics really is.
Mica can be animated with the geometry model plus helper joints.
Particular emphasis is on gaze and attention simulation to focus on face social triangle for face and saccade simulation.
The game porting talk is boring to me so I did not pay much attention.
The sonic immersion talk is very good; the two presenters skillfully use non-VR demos to demonstrate the importance of sound effects for immersive ambisonics.
More information can be found about ICTUS audio.

I went to lunch at Cow Cafe (a vegetarian place near the LA convention center south hall). The egg scrambles were good.

I spent the entire afternoon in the immersive pavilion.
Heterotopias performs cinematic cuts during blinks; the idea sounds very interesting but the demo does not really work for me as my glasses might have prevented accurate eye tracking.

I forgot that I actually had no paper in SIGGRAPH 2019 and thus would have to come into the papers fast forward with everyone else, and ended up sitting on the first row.
I had some quasi-dinner in the Beijing academy and Taipei parties afterwards.
I bumped into Kurt and recommended him to look at the Shard/Glasswing demo; he said that by nature he will ask a lot of pointed technical questions, and I told him that Gavin would be there to answer.

\paragraph{Monday}

I went to register for the Mica demo, and bumped into Zhenyi in the queue. She mentioned goo.gl/x5RQHN as a related work.

I could not get into the NASA VR session, so I went to the experience art talk (AI and embodied experience) instead.
Lavin trains a junky neural network to output limited vocabulary for a person image, and renders the corresponding 3D shapes in VR.
The hugging sculpture photogrammetry is also interesting.

Cow Cafe ran out of materials for scramble eggs, so I ended up with a less tasty avocado toast. I guess they also ran out of arugula and gave me romaine lettuce instead.

Mica demo has interesting interactivity, the graphics is not as opaque as it should be (as I expected) but it is ok. I did not try to go off the script as the aim is visual not interaction. But I still managed to break the demo in 10 seconds.

On my way to the keynote Johannes told me it was really bad and unprepared. It is unscripted, but not as bad as he commented. Sometimes we can learn more about the speaker from a spontaneous talk.

The Spheres VR movie is very good; Darren Aronofsky is listed as a contributor.

The de-noising session looks interesting so I went there.
Color space sculpting seems like a simple and effective idea for color edit.
I doubt how general the neural-network de-speckle approach can be.

When I arrived at the NVIDIA party after the only electronic theater show, the hotel staff was already starting to take away the food.

\paragraph{Tuesday}

I went to the After Effects creative medium workshop. I cannot really follow due to small display text but managed to experiment with the tutorial file a bit to get the gist (usual scripting and compositing stuff over the video time line).
Basically, there are people using Ae purely for synthetic effects instead of video post processing.

I then went to the hardwearable session.
Missed most of the NVIDIA AR eyeglass talk.
The electric control plastic haptic device looked interesting and I made a mental note to try in etech.
Artificial tail and temperature control auxetic are also interesting.

The interactive street art AR workshop is fun and reminded me about Aero authoring.

Real-time live was fun as usual. Hair VR did not win the best show but Liwen and Hao did a great demo (with Jun’s head).

I skipped the Stanford reunion and went straight to the Facebook party; the venue is great!
After giving my drink tickets to Kari, he told me that the Stanford reunion got great drinks.


I did not manage to attend the Adobe party before closing.

\paragraph{Wednesday}

I spent most of the morning in the VR demos.
The guy in the autism AR app told me about how png used to support vector graphics.
The OVS + tumor VR app looked and interacted very well.
The VR redirected walking space station demo (Frank Steinickie) worked very well by simply using highly occluded environment with task distraction without even leveraging blinks or saccades.
The unreal workshop is fun; one can place geometry scene structures for a character to move around for a simple game level.
Being Henry VR movie with gaze and blink control works very well and realistically simulates the situation of someone who could not move except with eyes and a hand.

After accidentally attending the women lunch in UIST 2016, I bravely attended the Berthouzoz women lunch in SIGGRAPH and even more bravely volunteered as a discussion leader.
The speakers were inspirational but I had to cut short the lunch to attend a meeting with Illustrator guys coming all the way from India.
The meeting was very productive and I managed to come up with four potential projects.

The DreamWorks party got good food; it took place inside the convention center, so very easy to attend.

The game of thrones production session was fun even though I never watched the show.
It was too late to attend the Snap party afterwards, so I went to the Apple party. The Canadian party was right around my hotel but I was too sleepy to go.

\paragraph{Thursday}

I got up early for the Glasswing talk session at 9 am, and tried some VR stuff afterwards, such as T-Rex assembly, beach muscle building, etc.

I did not realize the physical pad (Bamboo) is actually linked with Wacom Inkspace, and had a great time experimenting with the hardware.

Autodesk fusion 360 create cad shapes to guide drawing in sketchbook, I got the idea even though I could not create complex shapes.

I bumped into Jonash and lunched with him in Cow Cafe (which kindly gave me a discount code).
I had to miss the Alita production session for flight, which was delayed for 2 hours. I plan not to cut short of the conference in the future unless I really must fit a flight schedule (not between LAX and SFO).

TODO: checkout the blackhole talk, which people told me was great and should be the keynote. Why they put these really interesting forwward looking stuff in the early mornings?

February 28, 2019

Reviewer toughness score

Filed under: Real — liyiwei @ 9:54 am
Tags:

“Your reviewer toughness score is 20%. This means that 20% of the time you gave lower scores than the other reviewers of the submissions you reviewed. Reviewers are encouraged to maintain a toughness score closer to 50% so that they are working on roughly the same scale. You may want to update your reviews with this in mind.”

I wonder what is going to happen if all reviewers actually try to reach the 50% toughness level. Meanwhile, I will maintain my independent opinions.

December 18, 2018

Sharing publications

Filed under: Real — liyiwei @ 11:21 am
Tags:

Every time I see people listing publications on their websites without linking to the papers or videos, I hear they say: I am here to show off my publications and I do not really care whether you can access the papers. (Or, in a slightly more excusable scenario: I am too weak to not bow to the publisher request of withholding preprints online for 1 year. BTW this is why I do not submit to CGF.)

Best practice: create a public GitHub repo/page to share all paper information (abstract, pdf, video, code, etc.), so that all co-authors can edit and the search engines can index. (I am doing this for all my recent papers.)

December 16, 2018

Computer science publication model

Filed under: Real — liyiwei @ 3:57 pm
Tags:

If you need to try out a method, which you do first: (1) read and implement papers, (2) compile and run open source codes.

The peer review model for scientific publications has not changed much for centuries. It is about to, at least for computer science and especially for machine learning (e.g. distill.pub), where sharing and reproduction is much easier than other science and engineering disciplines.

December 9, 2018

Fence

Filed under: Real — liyiwei @ 5:03 pm
Tags:

I was searching my email box about the “fence” of the house and surprised to find out how many paper reviews contain the phrase “on the fence”.

Next Page »

Theme: Rubric. Get a free blog at WordPress.com