Search Results for author:
Found 2 papers, 0 papers with code
OccFusion: Depth Estimation Free Multi-sensor Fusion for 3D Occupancy Prediction
We introduce OccFusion, a multi-modal fusion method free from depth estimation, and a corresponding point cloud sampling algorithm for dense integration of image features.
LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens
This is achieved by three key innovations: (i) we identify and exploit two forms of non-uniformities in positional interpolation through an efficient search, providing a better initialization for fine-tuning and enabling an 8x extension in non-fine-tuning scenarios; (ii) we introduce a progressive extension strategy that first fine-tunes a 256k length LLM and then conducts a second positional interpolation on the fine-tuned extended LLM to achieve a 2048k context window; (iii) we readjust LongRoPE on 8k length to recover the short context window performance.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
