I feel that the Harry Potter universe certainly has enough detail to be adapted into a TV show, but I honestly don't feel good about it ): I know some movies have done well as a TV series, one that springs to mind is How To Train A Dragon, but there is definitely a drop in quality with the translation over to TV. While the TV series is more aimed at younger children, I feel like the Harry Potter world will draw in a large more diverse audience and long-term HP lovers who have certain expectations that might not be met. I don't want to see happen to any section of the Harry Potter world you know? I mean... maybe if they have a budget similar to Game of Thrones it would be fantastic, but I doubt it!
That being said, I think out of all the areas of the HP world to base a TV series on, Fantastic Beasts have some great content they can draw on -- like the adventures of Newt Scamander and friends while writing entries into his book! Or even a Quidditch one, following a student fresh out of Hogwarts trying to make it big! That would definitely be a drama-filled one, though the visual effects budget would have to be huge.