Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

For general discussion of Pet Shop Boys topics.
Message
Author
User avatar
rashomon
Posts: 1461
Joined: Mon 26 Sep 2005, 11:44 am
Contact:

Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#1 Post by rashomon »

Hi all

A bit of Sunday night fun! :D

I've finally got my little PSB lyrics project now completed - taken a while but I've collated all the PSB lyrics taken from the official site as at May 2020 and transposed these into a mega monster Excel spreadsheet.

After much cutting, chopping and applying various formulae I've managed to break out the lyrics into words so I could do some basic stats work on them - yep I'm currently out of work and bored.

Anyway, just for a bit of fun here are some questions you can try answering - I'll share answers tomorrow according to the spreadsheet:

1. The longest song title (number of characters including spaces)
2. The song with the MOST number of words
3. The song with the FEWEST number of words
4. The most frequently occurring word across all PSB lyrics (excluding stop words like 'a', 'in', 'it' etc)
5. The longest word (number of characters)

*Note: I've excluded cover versions and alternate versions also so bear that in mind.

I'll share the full spreadsheet with petheads if it's of interest - at the very least it will make searching for specific lyrics a bit easier as all lyrics are one one worksheet :dance:
you could say conventional ... and I could claim intentional

User avatar
Greendrake
Posts: 660
Joined: Wed 29 Oct 2003, 6:56 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#2 Post by Greendrake »

Haha.. This is one of the PSB-related projects I've had on my todo list for ages. Jealous that someone has done it faster but glad :D

User avatar
Ghost within this house
Posts: 3175
Joined: Sat 01 Nov 2003, 9:41 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#3 Post by Ghost within this house »

rashomon wrote:
Sun 24 May 2020, 8:50 pm
Hi all

A bit of Sunday night fun! :D

I've finally got my little PSB lyrics project now completed - taken a while but I've collated all the PSB lyrics taken from the official site as at May 2020 and transposed these into a mega monster Excel spreadsheet.

After much cutting, chopping and applying various formulae I've managed to break out the lyrics into words so I could do some basic stats work on them - yep I'm currently out of work and bored.

Anyway, just for a bit of fun here are some questions you can try answering - I'll share answers tomorrow according to the spreadsheet:

1. The longest song title (number of characters including spaces)
2. The song with the MOST number of words
3. The song with the FEWEST number of words
4. The most frequently occurring word across all PSB lyrics (excluding stop words like 'a', 'in', 'it' etc)
5. The longest word (number of characters)

*Note: I've excluded cover versions and alternate versions also so bear that in mind.

I'll share the full spreadsheet with petheads if it's of interest - at the very least it will make searching for specific lyrics a bit easier as all lyrics are one one worksheet :dance:
Ok, I'm going to guess - for a laugh:

1. You only tell me you love me when you're drunk
2. Legacy
3. Inner Sanctum
4. Love / Song(s)
5. Enschuldigung
Firing verbal shots.......like a Tommy Gun

User avatar
Ghost within this house
Posts: 3175
Joined: Sat 01 Nov 2003, 9:41 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#4 Post by Ghost within this house »

Or, for 5., Warschauerstrasse
Firing verbal shots.......like a Tommy Gun

User avatar
Xakrij
Posts: 130
Joined: Tue 13 Dec 2016, 2:11 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#5 Post by Xakrij »

1. I don't know what you want but I can't give it any more
2. Thursday
3. Generic jingle
4. Love
5. Warschauerstraße / resurrectionist
Shot in the fatal cause 'of frock-and-droll'

User avatar
tottenhammattspurs
Posts: 3430
Joined: Sat 04 Nov 2006, 6:17 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#6 Post by tottenhammattspurs »

Ghost within this house wrote:
Mon 25 May 2020, 10:03 am
rashomon wrote:
Sun 24 May 2020, 8:50 pm
Hi all

A bit of Sunday night fun! :D

I've finally got my little PSB lyrics project now completed - taken a while but I've collated all the PSB lyrics taken from the official site as at May 2020 and transposed these into a mega monster Excel spreadsheet.

After much cutting, chopping and applying various formulae I've managed to break out the lyrics into words so I could do some basic stats work on them - yep I'm currently out of work and bored.

Anyway, just for a bit of fun here are some questions you can try answering - I'll share answers tomorrow according to the spreadsheet:

1. The longest song title (number of characters including spaces)
2. The song with the MOST number of words
3. The song with the FEWEST number of words
4. The most frequently occurring word across all PSB lyrics (excluding stop words like 'a', 'in', 'it' etc)
5. The longest word (number of characters)

*Note: I've excluded cover versions and alternate versions also so bear that in mind.

I'll share the full spreadsheet with petheads if it's of interest - at the very least it will make searching for specific lyrics a bit easier as all lyrics are one one worksheet :dance:
Ok, I'm going to guess - for a laugh:

1. You only tell me you love me when you're drunk
2. Legacy
3. Inner Sanctum
4. Love / Song(s)
5. Enschuldigung
1. Where The Streets Have No Name (I Cant Take My Eyes Off You)
1b. (as you aren’t including covers) I Don’t Know What You Want But I Cant Give It Anymore
2. Metamorphosis
3. Pazzo!
4. The
5. Einshuldingung (or however it’s spelt)
is is and isnt isnt

User avatar
rashomon
Posts: 1461
Joined: Mon 26 Sep 2005, 11:44 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#7 Post by rashomon »

Pretty good effort all!

Here are the 'answers' according to the spreadsheet!

Please forgive me In advance as I may have made some mistakes here or there ...

Longest song title

1) I don’t know what you want but I can’t give it any more 55
2) The night is a time to explore who you are (demo) 49
3) This must be the place I waited years to leave 46
4) You only tell me you love me when you're drunk 46
5) How can you expect to be taken seriously? 41


Song with most words

1) My night - 573
2) Left to my own devices - 550
3) Thursday (featuring Example) -485
4) One thing leads to another - 425
5) Happiness is an option - 393


Song with fewest words

1) Playing in the streets - 8
2) Generic jingle - 11
3) Inner sanctum - 17
4) Entschuldigung! - 19
5) Postscript - 28


Most frequently occurring words - excluding stop words

1) love - 383
2) night - 179
3) life - 161
4) time 151
5) day - 150


Longest words - character length

1) Warschauerstraße - 16
2) resurrectionist - 15
3) Nollendorfplatz - 15
4) revolutionaries - 15
5) undistinguished - 15
you could say conventional ... and I could claim intentional

User avatar
leesmapman
Posts: 1844
Joined: Wed 03 May 2006, 11:51 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#8 Post by leesmapman »

My head is spinning probably has the fewest words? (depends on how you define fewest words)

User avatar
rashomon
Posts: 1461
Joined: Mon 26 Sep 2005, 11:44 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#9 Post by rashomon »

Yep it can get quite subjective! ... I just did it on a simple word count as per the official lyrics not anything more clever like unique words.

I also took the opportunity to create a funky little word cloud based on frequent words. The link to the spreadsheet is below so if anyone is interested, feel free to download a copy :D

https://we.tl/t-6FRSDwzJjc
Attachments
PSB lyrics word cloud.jpg
PSB lyrics word cloud.jpg (1.21 MiB) Viewed 896 times
you could say conventional ... and I could claim intentional

Future Lover
Posts: 718
Joined: Mon 14 Jul 2014, 1:04 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#10 Post by Future Lover »

I think #1 should be "Where the streets have no name (I can't take my eyes off you)" - 61 characters
Wayne also agrees: http://www.geowayne.com/newDesign/lists/longest.htm

User avatar
tottenhammattspurs
Posts: 3430
Joined: Sat 04 Nov 2006, 6:17 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#11 Post by tottenhammattspurs »

Surely Pazzo or One Hit Wonder have the fewest words?
is is and isnt isnt

User avatar
onzio
Posts: 269
Joined: Tue 28 Oct 2003, 1:54 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#12 Post by onzio »

rashomon wrote:
Tue 26 May 2020, 8:33 pm
Pretty good effort all!
Most frequently occurring words - excluding stop words
Oh, very interesting and what about the word that is present in more songs?
Could you do that with your excel file?
Expressing passion, explaining pain
This is my kind of music

User avatar
leesmapman
Posts: 1844
Joined: Wed 03 May 2006, 11:51 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#13 Post by leesmapman »

Due to lockdown and COVID19, I found some time to do a little hobby-ing. So I've grabbed all lyrics from the PSB website and stored them in a SOLR/Lucine search index. I made a simple front-end for it, for your convenience.

http://136.144.210.38/psb.php

Sorting is based on relevance.
Enjoy!

[edit] I've added a terms list for the first 1000 most common terms.
http://136.144.210.38/terms.php

[edit2] I've now also added a terms list with document-frequency (per song lyric):
http://136.144.210.38/terms_df.php

domino
Posts: 287
Joined: Sat 05 Jan 2019, 10:23 pm
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#14 Post by domino »

leesmapman wrote:
Sun 16 Aug 2020, 7:35 pm
[…]

[edit2] I've now also added a terms list with document-frequency (per song lyric):
http://136.144.210.38/terms_df.php
183 x "br"? :lol:

Nice list anyway! :clap:
A blues would be in B flat, pain defining wisdom,
but the soul is in the high hat, programmed in the system.

User avatar
leesmapman
Posts: 1844
Joined: Wed 03 May 2006, 11:51 am
Contact:

Re: Pet Shop Boys "Lyrically" ... a statistical analysis of PSB lyrics

#15 Post by leesmapman »

Looks like I need to filter out the <br/> tag from the website... [edit] done
Last edited by leesmapman on Sun 16 Aug 2020, 10:41 pm, edited 1 time in total.

Post Reply

Who is online

Users browsing this forum: No registered users and 21 guests