Confessions of a researchaholic

October 25, 2024

Hans Zimmer isn’t scared of AI

Filed under: Real — liyiwei @ 2:39 pm
Tags:

Because AI can only look at the past but not create the future.

October 23, 2024

Digital painting apps – good to use, hard to monetize

Filed under: Real — liyiwei @ 1:44 pm
Tags: ,

Adobe Fresco is free for all now!
Give a try if you are into painting/drawing/motion and have a touch/stylus-supported device running iOS/Windows.



Compared to apps that have a larger audience (e.g., social media) or higher margins (e.g., business/productivity), digital painting aims for those who have the skills and interests to create art and who often do this for fun instead of work.
I guess this is why the Procreate CEO once commented that they make money in order to make the app, not the other way around.

October 19, 2024

Adobe MAX Sneaks

Filed under: Real — liyiwei @ 11:26 am
Tags:

Presenting in Adobe MAX Sneaks turns out to be a very fun and rewarding experience and quite different from presenting in SIGGRAPH or other large academic conferences – higher stakes, deeper-vested audience, to entertain than to inform, larger teamwork, and more rehearsals.
See the list of presentations here.

October 11, 2024

Sleep infinity

Filed under: Imaginary,Real — liyiwei @ 9:29 pm
Tags:

I was trying to keep my (interactive) run-ai job running instead of being “succeeded” and realized that I could use “sleep infinity” as the entry command.

https://youtube.com/shorts/3iIka9vMP8w
https://www.behance.net/gallery/210033783/SleepInfinity

October 9, 2024

Accidental art from a broken train station display

Filed under: Imaginary,Real — liyiwei @ 11:22 am
Tags: ,

Saw this broken train station display showing intriguing patterns caused by the interactions between the surrounding light and display structure, and got some inspiration to create abstract art from it.

September 23, 2024

A brief history of intelligence

Filed under: Real — liyiwei @ 8:33 pm
Tags:

This is an excellent overview of the evolution of biological intelligence and the relationships to the progress of artificial intelligence so far, covering the five major stages of steering, reinforcing, simulating, mentalizing, and language. Perhaps the major takeaway is the hierarchical structure of different brain components specializing in different tasks, analogous to the computational higher-order and global workspace theories as surveyed in https://arxiv.org/abs/2308.08708.
The text is very easy to follow and the illustrations are nice to look at.

September 22, 2024

Unexpected intellectual discovery

Filed under: Real — liyiwei @ 3:31 pm
Tags:

There are several aspects of scientific research that excite me: solving a challenging problem, publishing a paper, shipping a product, creating a demo/artwork, presenting a talk, reviewing a submission, serving on a committee, attending a conference, meeting people with shared interests, working with collaborators.

But what excites me the most is discovering new ideas and insights, especially those that are surprising or unexpected.
Looking back at my research career, here are some examples:

  • My PhD thesis work on texture synthesis – fixed neighborhoods, over manifold surfaces, from multiple sources (blending and 3D volumes from 2D views), and order-independent/random-accessible synthesis.
  • Tile-based texture mapping, in particular the math and algorithms for packing and random access.
  • Parallel white noise and blue noise generation, analogous to the order-independent texture synthesis.
  • Inverse texture synthesis, basically a reversal of traditional (forward) texture synthesis.
  • Nonlinear Beam Tracing on a GPU \cite{Liu:2011:NBT} – it is possible to use rasterization to achieve some ray tracing effects.
  • Nonlinear revision control for images – revision control can be applied beyond code and text!
  • Differential domain analysis for non-uniform sampling – the trigonometric expansion of the power spectrum depends only on the relative sample positions, and the subsequent synthesis method of point sampling with general noise spectrum.
  • Improving light field camera sample design with irregularity and aberration – randomness/noise helps with computational photography.
  • Autocomplete painting repetitions, hand-drawn animations, and 3D sculpting – the use of workflows for analysis and prediction.
  • Mapping virtual and physical reality and the subsequent work on leveraging temporary blindness to avoid warping at all for redirected walking \cite{Sun:2018:TVR}.

In retrospect, I tend to have more focus, and likely as a consequence, more innovation during the earlier stage of my career, and more breadth (in terms of topics and applications) towards the later stage.
But it is really the unexpected intellectual discovery that keeps me excited, which I missed.

September 4, 2024

Cupcake wars – motion graphics

Filed under: Imaginary,Real — liyiwei @ 5:15 pm
Tags:

This is an experiment to create motion graphics from the original poster image (in the event email), which, upon looking at it, prompted me to want to animate the cupcake topping.

I started by twirling the topping via Motionleap, selecting the candy particles via Photoshop and animating them via Fresco Motion, followed by generative stylization via a comfyUI workflow (using the MotionLeap + Fresco video as control and its first frame as style input for IP-adapter). The challenge is that the output background won’t be completely black/transparent (which hopefully will be fixed soon in standard generative video workflows), and thus for now I did some masking and keying in After Effects as a workaround for proper compositing.




https://www.behance.net/gallery/207181031/CupcakeWars

September 3, 2024

Side effect of wearing company t-shirt in public

Filed under: Real — liyiwei @ 6:27 pm
Tags: ,

The conductor on my evening train came to me and joked that “Adobe should lower the price”.

https://www.behance.net/gallery/186107513/PortraitsMotoGStylus/modules/1176410825

« Previous PageNext Page »

Theme: Rubric. Get a free blog at WordPress.com