![图片](https://image.jiqizhixin.com/uploads/editor/e0788245-698f-42b9-a515-438a77292d67/640.png)
AIxiv专栏是机器之心发布学术、技术内容的栏目。过去数年,机器之心AIxiv专栏接收报道了2000多篇内容,覆盖全球各大高校与企业的顶级实验室,有效促进了学术交流与传播。如果您有优秀的工作想要分享,欢迎投稿或者联系报道。投稿邮箱:liyazhou@jiqizhixin.com;zhaoyunfeng@jiqizhixin.com
该文章的第一作者帅欣成,目前在复旦大学FVL实验室攻读博士学位,本科毕业于上海交通大学。他的主要研究方向包括图像和视频编辑以及多模态学习。
论文题目:A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models 发表单位:复旦大学 FVL 实验室,南洋理工大学 论文地址:https://arxiv.org/abs/2406.14555 项目地址:https://github.com/xinchengshuai/Awesome-Image-Editing
![图片](https://image.jiqizhixin.com/uploads/editor/31a2b38b-21c6-4064-9d26-e4db77bbb890/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/596007df-df16-4761-afcc-26458668bf90/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f0afc6b8-db96-4888-98fc-259b9cbaf21d/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/ad455e06-4a3f-42f4-9248-26ac3595ef98/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/c8399c5a-a56d-49a9-9589-937e232903e5/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/dca71e61-e8f3-4545-b6c7-fdf9af9e7c5e/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/ebad2e69-cd5c-40f0-9ddd-4866ed9ed57d/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f69d1685-58e1-42c5-9d18-b798c506c5b4/640.png)
Tuning-based inversion
通过原有的 diffusion 训练过程将源图像集合植入到扩散模型的生成分布中。形式化过程为:
![图片](https://image.jiqizhixin.com/uploads/editor/8b8e8379-11c5-46f4-966e-4775bd1d5577/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/db261764-a307-48df-be7e-2446b3b7cb0f/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/e45a2cfa-9e7a-4dbf-9399-7e0d0a0bdc83/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/7ce21483-9346-4bc4-81dd-e44d5539ff53/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/73a02de2-b878-4c34-8b82-25918b1254ce/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f96bb0bb-7b30-44c6-b935-383670488e4b/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/5168c822-6087-484b-882a-08d76418d8f3/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/3595897e-4ffe-480c-a5f3-11c48f8b0213/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/43a2be25-6469-4482-89c7-527709fb319c/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/d8b9b75e-b331-4102-85a6-016f113c675a/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f4a1ee0d-41cb-46a8-88bf-01f671a99637/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/628c58ae-cfce-465c-b8be-6f93b9a2a487/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/99e11036-35e0-4bdd-bc9a-58cb10e96fa5/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/0d542b83-9930-40b6-b8f8-228a88470668/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/043dfec0-e849-4cf8-b65a-37f3379df7ca/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/94c27f65-a470-4cec-9390-e7ae0f4abc3f/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/31687a96-6bd8-4ea5-ac7b-ea180f28a80a/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/d2468d35-d627-4880-aaf0-ff89a4a87d52/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/94d53f86-0c97-43c9-93c7-f54d5cdd3686/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/0150e8fe-4fae-4c3e-952d-3b0ac6eedb61/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/acd1cadd-8b1b-4d43-a335-305e762def21/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f2c1c2ed-7df8-4007-a5eb-19963f004be0/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f0838d51-ba19-4c6f-a40c-51f3a1fbb382/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/43575e21-9107-42b9-9853-1f98a6940c48/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/f99f86c8-246f-4a31-af84-e1d7bbd5caba/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/fe0d0b61-9fd2-4492-8d8b-bd42200e816c/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/73c09920-9895-4841-be58-173fd1b5a6e8/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/c124d713-e10c-4842-a96d-0789cff10061/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/afb4a3e3-991c-4f0b-9bed-a06c0d44b2f5/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/3df5ada7-8714-4ce7-9792-ee84054e1a56/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/39bdfd81-4354-4ea9-a22a-5fad61660b17/640.png)
![图片](https://image.jiqizhixin.com/uploads/editor/75b19429-d328-492a-88bf-bde10302593e/640.png)