add paddle3d and bevfusion model training #2749
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
cuicheng01
reviewed
Jan 6, 2025
| ## 4. 数据准备和校验 | ||
| ### 4.1 数据准备 | ||
|
|
||
| 本教程采用 `nuScenes`数据集 作为示例数据集，请在[官网](https://www.nuscenes.org/nuscenes)进行下载，将数据集目录准备如下： |
| |—— v1.0-trainval | ||
| ``` | ||
|
|
||
| 在`./paddlex/repo_manager/repos/Paddle3D`的目录下创建软链接 `data/nuscenes`，指向到上面的数据集目录： |
There was a problem hiding this comment.
其实不太希望让用户在这个目录下创建内容，PaddleX对大多数用户来说，希望这个repos是无感的。这块看是否挪出去呢？
| mkdir data | ||
| ln -s /path/to/nuscenes_dataset_root ./data | ||
| mv ./data/nuscenes_dataset_root ./data/nuscenes | ||
| ``` |
There was a problem hiding this comment.
关于用户自己的数据如何制作和标注，需要补充文档说明下
|
|
||
| BEVFusion模型训练需要加载camera分支模型预训练分支和lidar分支模型预训练权重： | ||
| ```bash | ||
| wget https://paddle3d.bj.bcebos.com/models/bevfusion/camera/model.pdparams |
There was a problem hiding this comment.
这一块需要内置到代码中，在config中配置，尽量不让用户手动执行这些操作
| model: BEVFusion | ||
| mode: check_dataset | ||
| dataset_dir: "/paddle/dataset/paddlex/3d/nuscenes" | ||
| device: gpu:1,2,3,4 #0,1,2,3 |
|
|
||
|
|
||
| Export: | ||
| weight_path: /paddle/model/paddlex/3d/fusion.pdparams |
|
|
||
| Evaluate: | ||
| batch_size: 1 | ||
| weight_path: /paddle/model/paddlex/3d/fusion.pdparams |
| @@ -0,0 +1,96 @@ | |||
| # Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved. | |||
|
|
||
|
|
||
| class BEVFusionTrainer(BaseTrainer): | ||
| """Object Detection Model Trainer""" |
| @@ -0,0 +1,17 @@ | |||
| # Copyright (c) 2023 PaddlePaddle Authors. All Rights Reserved. | |||
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
add paddle3d and bevfusion model training. Original pr #2572