diff --git a/README.md b/README.md
index 7793d1a1cc..ecec1a8a46 100644
--- a/README.md
+++ b/README.md
@@ -59,14 +59,14 @@ English | [简体中文](README_zh-CN.md)
 
 ## What's New
 
-v0.10.3 was released on 2024-1-24.
+v0.10.4 was released on 2024-4-23.
 
 Highlights:
 
-- Add the support for musa device [#1453](#1453)
-- Add the usage of ProfilerHook [#1466](#1466)
+- Support custom `artifact_location` in MLflowVisBackend [#1505](#1505)
+- Enable `exclude_frozen_parameters` for `DeepSpeedEngine._zero3_consolidated_16bit_state_dict` [#1517](#1517)
 
-Read [Changelog](./docs/en/notes/changelog.md#v0103-2412024) for more details.
+Read [Changelog](./docs/en/notes/changelog.md#v0104-2342024) for more details.
 
 ## Introduction
 
@@ -102,7 +102,7 @@ MMEngine is a foundational library for training deep learning models based on Py
 | MMEngine           | PyTorch      | Python         |
 | ------------------ | ------------ | -------------- |
 | main               | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
-| >=0.9.0, \<=0.10.3 | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
+| >=0.9.0, \<=0.10.4 | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
 
 </details>
 
diff --git a/README_zh-CN.md b/README_zh-CN.md
index 837401bdd2..6ce45e0ac5 100644
--- a/README_zh-CN.md
+++ b/README_zh-CN.md
@@ -59,14 +59,14 @@
 
 ## 最近进展
 
-最新版本 v0.10.3 在 2024.1.24 发布。
+最新版本 v0.10.4 在 2024.4.23 发布。
 
 版本亮点：
 
-- 适配摩尔线程 [#1453](#1453)
-- 添加 ProfilerHook 使用文档 [#1466](#1466)
+- 支持在 MLFlowVisBackend 中自定义 `artifact_location` [#1505](#1505)
+- 支持在 `DeepSpeedEngine._zero3_consolidated_16bit_state_dict` 使用 `exclude_frozen_parameters` [#1517](#1517)
 
-如果想了解更多版本更新细节和历史信息，请阅读[更新日志](./docs/en/notes/changelog.md#v0103-2412024)。
+如果想了解更多版本更新细节和历史信息，请阅读[更新日志](./docs/en/notes/changelog.md#v0104-2342024)。
 
 ## 简介
 
@@ -107,7 +107,7 @@ MMEngine 是一个基于 PyTorch 实现的，用于训练深度学习模型的
 | MMEngine           | PyTorch      | Python         |
 | ------------------ | ------------ | -------------- |
 | main               | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
-| >=0.9.0, \<=0.10.3 | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
+| >=0.9.0, \<=0.10.4 | >=1.6 \<=2.1 | >=3.8, \<=3.11 |
 
 </details>
 
diff --git a/docs/en/notes/changelog.md b/docs/en/notes/changelog.md
index 08a54c7130..8d5413124b 100644
--- a/docs/en/notes/changelog.md
+++ b/docs/en/notes/changelog.md
@@ -1,5 +1,29 @@
 # Changelog of v0.x
 
+## v0.10.4 (23/4/2024)
+
+### New Features & Enhancements
+
+- Support custom `artifact_location` in MLflowVisBackend. by [@daavoo](https://github.com/daavoo) in https://github.com/open-mmlab/mmengine/pull/1505
+- Add the supported pytorch versions in README by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1512
+- Perform evaluation upon training completion by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1529
+- Enable `exclude_frozen_parameters` for `DeepSpeedEngine._zero3_consolidated_16bit_state_dict` by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1517
+
+### Bug Fixes
+
+- Fix warning capture by [@fanqiNO1](https://github.com/fanqiNO1) in https://github.com/open-mmlab/mmengine/pull/1494
+- Remove codeowners file by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1496
+- Fix config of readthedocs by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1511
+- Delete frozen parameters when using `paramwise_cfg` by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1441
+
+### Docs
+
+- Refine mmengine intro by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1479
+- Fix typo by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1481
+- Fix typos and remove fullwidth unicode chars by [@evdcush](https://github.com/evdcush) in https://github.com/open-mmlab/mmengine/pull/1488
+- Fix docstring of Config by [@MambaWong](https://github.com/MambaWong) in https://github.com/open-mmlab/mmengine/pull/1506
+- Fix typo by [@hiramf](https://github.com/hiramf) in https://github.com/open-mmlab/mmengine/pull/1532
+
 ## v0.10.3 (24/1/2024)
 
 ### New Features & Enhancements
diff --git a/mmengine/version.py b/mmengine/version.py
index cfc82fdadc..20624d834f 100644
--- a/mmengine/version.py
+++ b/mmengine/version.py
@@ -1,6 +1,6 @@
 # Copyright (c) OpenMMLab. All rights reserved.
 
-__version__ = '0.10.3'
+__version__ = '0.10.4'
 
 
 def parse_version_info(version_str):