I'm a bit of an eclectic mess ๐ I've been a programmer, journalist, editor, TV producer, and a few other things.
I'm currently working on my second novel which is complete, but is in the edit stage. I wrote my first novel over 20 years ago but then didn't write much till now.
"Magic: Multi Art Genre Intelligent Choreography Dataset and Network for 3D Dance Generation. (arXiv:2212.03741v3 [cs.CV] UPDATED)" โ A choreography dataset and a network for generating 3D dance segments based on a music clip as input.
"Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning. (arXiv:2302.14794v1 [cs.CV])" โ Rather than using a frozen language model to communicate visual concepts, this method uses a meta -mapper to act as a bridge between large-scale visiona and language models.
"TextIR: A Simple Framework for Text-based Editable Image Restoration. (arXiv:2302.14736v1 [cs.CV])" โ Using text input to restore damaged images by specifying how to fill in the damage areas by way of text descriptions.
"Towards Enhanced Controllability of Diffusion Models. (arXiv:2302.14368v1 [cs.CV])" โ Creating a diffusion model that is easier to edit/style based on input images by conditioning the model on a spatial content mask and a flattened style embedding.
"One-Shot Video Inpainting. (arXiv:2302.14362v1 [cs.CV])" โ A method to inpaint videos where instead of having to provide masks for each frame, you only need to provide the object mask for the initial frame in the video sequence.
"Deep Learning for Identifying Iran's Cultural Heritage Buildings in Need of Conservation Using Image Classification and Grad-CAM. (arXiv:2302.14354v1 [cs.CV])" โ Using machine learning to identify damage and defects to cultural heritage buildings using Convolutional Neural Networks (CNN).
"Accuracy and Fidelity Comparison of Luna and DALL-E 2 Diffusion-Based Image Generation Systems. (arXiv:2301.01914v2 [cs.CV] UPDATED)" โ Comparing the accuracy and fidelity of images generated by DALL-E 2 and Luna, which is Stable Diffusion-based.
"Diffusion Posterior Sampling for General Noisy Inverse Problems. (arXiv:2209.14687v3 [stat.ML] UPDATED)" โ Extending diffusion solvers to efficiently handle general noisy (non)linear inverse problems via approximation of the posterior sampling.
"Subspace Diffusion Generative Models. (arXiv:2205.01490v2 [cs.LG] UPDATED)" โ Restricting diffusion via projections onto subspaces to reduce computational time and cost without affecting the overall quality of the generated image.
"Large Scale Visual Food Recognition. (arXiv:2103.16107v3 [cs.CV] UPDATED)" โ A food dataset with 2,000 categories and over 1 million images that can be used for food recognition.
"Directed Diffusion: Direct Control of Object Placement through Attention Guidance. (arXiv:2302.13153v1 [cs.CV])" โ Controlling object placement in diffusion models by way of attention guidance.
"In What Languages are Generative Language Models the Most Formal? Analyzing Formality Distribution across Languages" โ Measuring the formality of the generated text for different languages using multilingual generative language models.
"ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation. (arXiv:2209.04145v6 [cs.CV] UPDATED)" โ Using 2D images as a stepping stone for creating 3D shapes and eliminating the need for paired text-shape data.
"Modulating Pretrained Diffusion Models for Multimodal Image Synthesis. (arXiv:2302.12764v1 [cs.CV])" โ Multimodal Conditioning Modules (MCM) for enabling conditional image synthesis using pretrained diffusion models so that you can generate images using not just a text prompt, but additional input such as a segmentation map or a sketch.
"Surface Recognition for e-Scooter Using Smartphone IMU Sensor. (arXiv:2302.12720v1 [eess.SP])" โ Detecting whether an e-scooter is on a paved road or a sidewalk using the Inertial Measurement Unit (IMU) sensors on a smartphone.
"ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors. (arXiv:2210.05950v2 [cs.CV] UPDATED)" โ Better image inpainting by detecting structures in the source image using techniques such as edge detection.
"Designing an Encoder for Fast Personalization of Text-to-Image Models. (arXiv:2302.12228v1 [cs.CV])" โ A method to teach text-to-image models new concepts in seconds.
"Aligning Text-to-Image Models using Human Feedback. (arXiv:2302.12192v1 [cs.LG])" โ A fine-tuning method for better aligning generated images to the input text prompt when using diffusion models.
"Evaluating the Efficacy of Skincare Product: A Realistic Short-Term Facial Pore Simulation. (arXiv:2302.11950v1 [cs.CV])" โ Simulating the effects of skincare products on your skin (specifically the pores) to gauge efficacy of the product.