For Swans - Pick up Various Failures, or Children of God/World of Skin, which to my mind is earthy and pungent and sets to music a lot of the themes and atmoshpere found in (US) Southern Gothic literature. For Angels - Start with New Mother. Songs: The Man with the Silver Tongue, or Praise Your Name. Another tremendous song, and very much in the style of Swans, is My True Body, from the album How I Loved You.
I'd post links, but at the moment that just isn't working.
Since your an Aussie, I'm sure you've heard of These Immortal Souls? You may like songs like Marry Me, or All the Money's Gone, especially if you're a Nick Cave man.
A few more artists you may like (and all with videos available on Youtube) - Matt Elliott, especially for the song Something About Ghosts. Benjamin Smoke is another you should certainly hear, if only for the song Curtains. Six Organs of Admittance, Munly, Wovenhand, Larsen.. There's a lot of stuff out there you'd probably like, and just checking into Michael Gira's Young God Records label for starters is a pretty good bet too.
Wich I could post videos, but I'm sure you'll find enough here to keep you busy for a while. Hope it helps.