Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training for 80000 times #40

Open
jiesico opened this issue Mar 23, 2022 · 13 comments
Open

Training for 80000 times #40

jiesico opened this issue Mar 23, 2022 · 13 comments

Comments

@jiesico
Copy link

jiesico commented Mar 23, 2022

Hi!
Thank you very much for sharing the code of DROID_SLAM.
I've trained 80,000 times on the Tartanair dataset so far, but why hasn't loss_function shown any signs of convergence so far?

@fabiopoiesi
Copy link

Hi,

We are experiencing a loss like this during training Tartanair.

Screenshot from 2022-03-29 08-51-44

Is this something expected?

Thanks

@xhangHU
Copy link

xhangHU commented May 3, 2022

Can you use the weight file you got for testing? When I test with the weights I got from training, the following error is reported:
Traceback (most recent call last):
File "/root/docker2/droid/2new/DROID-SLAM/demo.py", line 117, in
traj_est = droid.terminate(image_stream(args.imagedir, args.calib, args.stride))
File "/root/docker2/droid/2new/DROID-SLAM/droid_slam/droid.py", line 81, in terminate
self.backend(7)
File "/root/anaconda3/envs/droidenv5/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 28, in decorate_context
return func(*args, **kwargs)
File "/root/docker2/droid/2new/DROID-SLAM/droid_slam/droid_backend.py", line 33, in call
graph.add_proximity_factors(rad=self.backend_radius,
File "/root/docker2/droid/2new/DROID-SLAM/droid_slam/factor_graph.py", line 368, in add_proximity_factors
ii, jj = torch.as_tensor(es, device=self.device).unbind(dim=-1)
ValueError: not enough values to unpack (expected 2, got 0)

@realXiaohan
Copy link

@xhangHU Hi, I have run the model with the weights they provide successfully but met the same problem as I used my self-trained weights. Did u solve this problem yet?

@xhangHU
Copy link

xhangHU commented Jun 6, 2022

@xhangHU Hi, I have run the model with the weights they provide successfully but met the same problem as I used my self-trained weights. Did u solve this problem yet?

It's not solved yet, and I checked that the network structure used in the pre-training model provided by the author is not the same as in the code provided

@lvmingzhe
Copy link

@xhangHU Hi, can I have your email please? We can talk about it in more detail.

Hi, could I join yours? I would like to retrain the model but got stuck in the beginning. Thanks a lot.
12131040[at]mail.sustech.edu.cn

@liuliu3dv
Copy link

@xhangHU Hi, I have run the model with the weights they provide successfully but met the same problem as I used my self-trained weights. Did u solve this problem yet?

It's not solved yet, and I checked that the network structure used in the pre-training model provided by the author is not the same as in the code provided

It maybe cause by, the distance of graph is loss than the thresh. Try to give a smaller thresh, the demo will run successfully. But I still meet some problem with the disps result

@realXiaohan
Copy link

@519174419 Yeah, I solved the problem by setting a smaller thresh but the ego-motion prediction looks so weird with my self-trained model. Is anything wrong with your disparity map?

@liuliu3dv
Copy link

**realXiaohan ** commented 16分钟前

Yes,I think the flow_loss and geo_loss is low, but it still something wrong with the disparity map.

@realXiaohan
Copy link

@519174419 We can talk about it in more detail and my email is [[email protected]].

@YznMur
Copy link

YznMur commented Jun 15, 2022

@519174419 Yeah, I solved the problem by setting a smaller thresh but the ego-motion prediction looks so weird with my self-trained model. Is anything wrong with your disparity map?

Hi @realXiaohan , could you please share your config for training and demo ?

@Aurora-chevalier
Copy link

Hello, I can't read the image when training the tartan dataset, can you show the instructions you used to train the tartan dataset
1

@Junda24
Copy link

Junda24 commented Jul 21, 2023

**realXiaohan ** commented 16分钟前

Yes,I think the flow_loss and geo_loss is low, but it still something wrong with the disparity map.

Hello, I have been stuck here for a long time now, may I ask if you have solved this problem? If it is convenient, can you add a contact information for detailed communication? I would like to ask you about my wechat 18186416709, email [email protected]

@Junda24
Copy link

Junda24 commented Jul 21, 2023

@519174419 Yeah, I solved the problem by setting a smaller thresh but the ego-motion prediction looks so weird with my self-trained model. Is anything wrong with your disparity map?
Hello, I have been stuck here for a long time now, may I ask if you have solved this problem? If it is convenient, can you add a contact information for detailed communication? I would like to ask you about my wechat 18186416709, email [email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants