27
I finally got my small language model to summarize a 10-page report in under 3 seconds
Last month, I was stuck with summaries that missed key points. I tweaked the attention mechanism based on a paper from a team in Berlin, and now it actually works. Has anyone else had luck with custom attention layers for this kind of task?
3 comments
Log in to join the discussion
Log In3 Comments
terryb111mo ago
My cousin tried something like that for his fantasy football recaps. He spent weeks trying to get an AI to pick out the best plays from game footage, but it kept highlighting the wrong players. I think he gave up and just hired a college kid to do it instead.
10
the_henry5h agoProlific Poster
Honestly, did your cousin figure out if the AI was just bad at knowing what a good play actually looks like, or was it more of a coding issue where it couldn't process the game footage right? Ngl, I always thought the problem with those tools is they don't understand context, like a garbage time touchdown vs a game-winning drive. Tbh, just hiring a college kid who actually watches football sounds way more reliable anyway. Did he end up paying the kid more or less than what he spent on the AI setup though?
5