Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Roadmap of MMDetection3d #16

Open
6 of 7 tasks
hellock opened this issue Jul 13, 2020 · 51 comments
Open
6 of 7 tasks

Roadmap of MMDetection3d #16

hellock opened this issue Jul 13, 2020 · 51 comments
Labels
community help wanted Need help from community good first issue Good for newcomers

Comments

@hellock
Copy link
Member

hellock commented Jul 13, 2020 •
edited by ZwwWayne
Loading

We keep this issue open to collect feature requests from users and hear your voice. Our monthly release plan is also available here.

You can either:

  1. Suggest a new feature by leaving a comment.
  2. Vote for a feature request with 👍 or be against with 👎. (Remember that developers are busy and cannot respond to all feature requests, so vote for your most favorable one!)
  3. Tell us that you would like to help implement one of the features in the list or review the PRs. (This is the greatest things to hear about!)

V0.7.0 (October-November)

  • Switch visualization backend to Open3D
  • More performance on Waymo, nuScenes, SUN RGB-D, and ScanNet dataset

V0.6.0 (September)
@hellock hellock added community help wanted Need help from community good first issue Good for newcomers labels Jul 13, 2020
@hellock hellock pinned this issue Jul 13, 2020
@turboxin
Copy link

Hi all, thanks for releasing this wonderful project！

I 'm wondering what's your recent development plan for new models or methods?

@thuyngch
Copy link

In the previous version (PCDet), I see that PV-RCNN is supported. However, it is not supported now. So, I hope to see PV-RCNN again.

@hellock
Copy link
Member Author

hellock commented Jul 15, 2020

In the previous version (PCDet), I see that PV-RCNN is supported. However, it is not supported now. So, I hope to see PV-RCNN again.

PCDet and mmdet3d are two different codebases. You may refer to PCDet for PV-RCNN now, and we will support it in mmdet3d soon.

@SilvioGiancola
Copy link

Thanks for the development of MMDetection3d. I would appreciate the support for the Waymo Dataset.

@chuong98
Copy link

Thanks for the opensource. Can we support 3DSSD https://github.com/Jia-Research-Lab/3DSSD?
It seems achieve both good speed and high AP.
Thank you.

@zehanzhang
Copy link

Can we support SA-SSD https://github.com/skyhehe123/SA-SSD？The AP and speed is also good.

@hhcNWPU
Copy link

hhcNWPU commented Sep 5, 2020

Hello, this code can visualize the 3D detection box in the point cloud, may I ask if the 3D detection box can be visualized in the 2D image，and how do we do that?

@xavierwu95 xavierwu95 mentioned this issue Sep 16, 2020
Closed
@linchunmian
Copy link

Hi. all. I hope to see the implementation of pseudo LiDAR in mmdetection3d. And also, I think more visualization of data processing and detection result are required, too.
Thanks.

@AllenPeng0209
Copy link

AllenPeng0209 commented Oct 12, 2020 •
edited
Loading

Hi, all.
the current strongest backbone SPVNAS could be a good thing to implement.
Also, it's new library torchsparse is much faster than the current library.

https://github.com/mit-han-lab/torchsparse
https://github.com/mit-han-lab/e3d/blob/master/spvnas/core/models/semantic_kitti/spvnas.py

@PersistentXQ
Copy link

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

@ZwwWayne
Copy link
Collaborator

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

@PersistentXQ
Copy link

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

ZwwWayne, thank you very much for your answer. I think I asked a wrong question… The new kitti-like dataset (x,y,z,intensity,another feature) have already been made. The question is how I can train the model with my dataset. I tried to change the "load_dims" and "use_dims" in configs from 4 to 5, but some errors were threw… After I fixed these errors, another errors were threw again… Now the newest error is Runtime Error: size mismatch.

@ZwwWayne
Copy link
Collaborator

Hi, all. If I wanna add a feature to dataset (for example, besides (x,y,z,intensity), I wanna add another feature to it and make the data become (x,y,z,intensity,another featrue).), could you guys provides some interfaces or functions or sth?

We recommend to do this in the model part. You can implement a new module to process the point data following the guide here

ZwwWayne, thank you very much for your answer. I think I asked a wrong question… The new kitti-like dataset (x,y,z,intensity,another feature) have already been made. The question is how I can train the model with my dataset. I tried to change the "load_dims" and "use_dims" in configs from 4 to 5, but some errors were threw… After I fixed these errors, another errors were threw again… Now the newest error is Runtime Error: size mismatch.

Feel free to create a new issue to describe your issues following the reimplementation issues template if you need some help. This issue is mainly about the roadmap.

@ZwwWayne
Copy link
Collaborator

Hi, all.
the current strongest backbone SPVNAS could be a good thing to implement.
Also, it's new library torchsparse is must faster than the current library.

https://github.com/mit-han-lab/torchsparse
https://github.com/mit-han-lab/e3d/blob/master/spvnas/core/models/semantic_kitti/spvnas.py

Thanks for the suggestion. We will investigate these repos and may change the dependency if necessary.

@YoushaaMurhij
Copy link

Can you add support for sematic-kitti ?

@ZwwWayne ZwwWayne closed this as completed Nov 5, 2020
@ZwwWayne ZwwWayne reopened this Nov 5, 2020
@chasingw
Copy link

any plan for ONNX support?

@ZwwWayne
Copy link
Collaborator

any plan for ONNX support?

This is a planned feature, but we may not support it very soon. So PRs are also welcomed.

@qinsimon
Copy link

Thanks for your job. And it would be nice if cuda11.1/torch1.7 are compatible

@chakri1804
Copy link

Can you add support for Pandaset ?

@filaPro
Copy link
Contributor

filaPro commented Jan 2, 2021

Do you have plans to release the code for your FCOS3D on NuScenes in near future?

@Tai-Wang
Copy link
Member

Tai-Wang commented Jan 2, 2021

Do you have plans to release the code for your FCOS3D on NuScenes in near future?

Yes. More information could be referred to #247 .

@Jsijon
Copy link

Jsijon commented Jan 31, 2021

Can you support Cirrus dataset ?
https://arxiv.org/abs/2012.02938

@lji72 lji72 mentioned this issue Apr 15, 2021
Closed
@Wuziyi616
Copy link
Contributor

Hello, this code can visualize the 3D detection box in the point cloud, may I ask if the 3D detection box can be visualized in the 2D image，and how do we do that?

Hi, this multi-modality visualization has been supported recently. Check out our demo and how to use for it!

@PersistentXQ
Copy link

PersistentXQ commented Feb 8, 2022 via email

@little-bookworm
Copy link

Do you have plans for model deployment and conversion？

@Tai-Wang Tai-Wang mentioned this issue Apr 26, 2022
Closed
@poddar414
Copy link

pointPainting

@PersistentXQ
Copy link

PersistentXQ commented May 24, 2022 via email

@nacayu
Copy link

nacayu commented Jun 16, 2022

It would be nice if mmdet3d could incorporate radar information like lidar, Our lab, and many radar researcher also need a good platform to employ radar and camera fusion and so on, thanks.

@PersistentXQ
Copy link

PersistentXQ commented Jun 16, 2022 via email

@xiaoyangyang123
Copy link

你好，请问dgcnn的内容是删除了嘛？什么时候重新上线呢？

@PersistentXQ
Copy link

PersistentXQ commented Jul 17, 2022 via email

@sxfzzz
Copy link

sxfzzz commented Aug 6, 2022

Would you consider RPVNet?
RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentation

@PersistentXQ
Copy link

PersistentXQ commented Aug 6, 2022 via email

@xiaoyangyang123
Copy link

你会考虑RPVNet吗？ RPVNet：用于激光雷达点云分段的深度高效范围-点-体素融合网络

有考虑用point transformer进行尝试，您说的这个我还没有细看。主要是想将新内容用在dgcnn上进行尝试提升，不知您有什么好的建议？

tpoisonooo pushed a commit to tpoisonooo/mmdetection3d that referenced this issue Sep 5, 2022
@AllentDan
Add trt instance norm plugin (open-mmlab#16)
b9e64f9 
* add trt instance norm plugin

* last line empty

* fix clang format

* fix grid_sample clang format

* remove redundant

* fix lint

* refine codes

* fix clang format

* clang format

* clang format

* clang format
tpoisonooo pushed a commit to tpoisonooo/mmdetection3d that referenced this issue Sep 5, 2022
@AllentDan
[Enhancement] support coverage (open-mmlab#16)
f693f7c 
* support coverage

* test codecov action 2
@CarlHuangNuc
Copy link

deep fusion and bevfusion

@PersistentXQ
Copy link

PersistentXQ commented Oct 28, 2022 via email

@JingweiZhang12 JingweiZhang12 mentioned this issue Dec 21, 2022
Open
@YoushaaMurhij
Copy link

Support radar data in nuScenes!

@PersistentXQ
Copy link

PersistentXQ commented Jan 18, 2023 via email

@JingweiZhang12 JingweiZhang12 mentioned this issue Feb 6, 2023
Open
2 tasks
@zhanghang1989
Copy link

Suggested by @JingweiZhang12 . Add request for Cube RCNN implementation.
It would be great if mmdetection3d could support Cube RCNN from Omni3d paper, so that we can easily compare across different method.

@PersistentXQ
Copy link

PersistentXQ commented Feb 6, 2023 via email

@schneidersebastian
Copy link

It would be nice if mmdet3d could incorporate radar information like lidar, Our lab, and many radar researcher also need a good platform to employ radar and camera fusion and so on, thanks.

Any updates on that?

@JingweiZhang12 JingweiZhang12 mentioned this issue Feb 16, 2023
Open
@mendoza-G mendoza-G mentioned this issue Mar 13, 2023
Open
3 tasks
@jumptiger66 jumptiger66 mentioned this issue Apr 25, 2023
Closed
@Xiangxu-0103 Xiangxu-0103 unpinned this issue Jul 5, 2023
@Xiangxu-0103 Xiangxu-0103 pinned this issue Jul 5, 2023
@aFickle
Copy link

aFickle commented Oct 28, 2023

为什么我就是实现不了目标检测的demo，谁能帮帮我

@PersistentXQ
Copy link

PersistentXQ commented Oct 28, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
community help wanted Need help from community good first issue Good for newcomers
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests