Google [no longer] indexing the forum

Discussion in 'Network Information, Suggestions and Feedback' started by PsyWar.Org, Mar 23, 2015.

Page 1 of 2
  1. PsyWar.Org

    PsyWar.Org Archive monkey

    Was searching for a post yesterday through Google and realised that no new ww2talk threads have been indexed by Google since last April (since 8th April 2014 to be precise)!

    e.g. https://www.google.com/search?q=site%3Aww2talk.com&biw=1920&bih=907&source=lnt&tbs=cdr%3A1%2Ccd_min%3A4%2F8%2F2014%2Ccd_max%3A3%2F23%2F2015&tbm=

    Last day's entry here: https://www.google.com/search?q=site%3Aww2talk.com&biw=1920&bih=907&source=lnt&tbs=cdr%3A1%2Ccd_min%3A4%2F7%2F2014%2Ccd_max%3A3%2F23%2F2015&tbm=

    This must be having a major impact on bringing in new vistors and members to the forum?


    There doesn't appear to be a robtos.txt for the site blocking spiders so wonder why Google hasn't crawled the new content? Previously a new forum post would appear in the search engine with in minutes.
    Could it be the home page of the site showing a list of forums rather than new content?
    Perhaps the home page should redirect here: http://ww2talk.com/forums/index.php?app=core&module=search&do=viewNewContent&search_app=forums ?


    Lee


    edited title to show it is now being indexed
     
    PsyWar.Org, Mar 23, 2015
    #1
  2. Nijmegen

    Nijmegen Member

    A "nofollow" or "noindex" in the wrong place?
     
    Nijmegen, Mar 23, 2015
    #2
  3. PsyWar.Org

    PsyWar.Org Archive monkey

    Could be but can't see anything obvious in page metadata or a noindex X-Robots-Tag being sent in the page headers.
     
    PsyWar.Org, Mar 23, 2015
    #3
  4. dbf

    dbf Moderatrix MOD

    Thanks for raising this.
    Rest assured that Otto has already been made aware and ... the forum is still here.

    I won't say don't carry on chaps, but personally, I don't think the open forum is the best place for discussing any technical set-up. ;)
     
    dbf, Mar 23, 2015
    #4
  5. KevinC

    KevinC Slightly wierd

    [​IMG]
     
    KevinC, Mar 23, 2015
    #5
    Nijmegen likes this.
  6. PsyWar.Org

    PsyWar.Org Archive monkey

    As long as the powers that be are aware that's the main thing. Would be a shame if search engines can't catalogue a year's worth of super content though.
     
    PsyWar.Org, Mar 23, 2015
    #6
  7. von Poop

    von Poop Adaministrator Admin

    Have been concerned about our Google search status for a long while.
    2F's seems to have picked up, so I can only really sit and hope.
    I may of course have screwed something up in an attempt to see if on-site settings could improve things, but think I eventually just mirrored 2F's settings, and threads get picked up pretty sharpish there of late.

    Will have a look again when back at the PC. Suspect this will remain beyond my pay grade to work out though.
     
    von Poop, Mar 23, 2015
    #7
  8. von Poop

    von Poop Adaministrator Admin

    Pleased to announce, that Otto seems to have finally cracked it.

    Sort of fascinating watching the indexing at work.
    If you're a terrible nerd...

    Which, as I suppose I'm not alone in suffering from, means I'll put up a link to the last year's missing Googloplex being filled up, just in case any passing nerds might be interested.:
    https://www.google.co.uk/#q=site:ww2talk.com&tbs=qdr:y

    Apologies again, but we are now no longer whistling in the Google dark.
    Probably...
     
    von Poop, May 12, 2015
    #8
    Fred Wilson and Drew5233 like this.
  9. PsyWar.Org

    PsyWar.Org Archive monkey

    Super! Well done Otto :salut:
     
    PsyWar.Org, May 12, 2015
    #9
  10. Drew5233

    Drew5233 #FuturePilot 1940 Obsessive

    Seconded :D
     
    Drew5233, May 12, 2015
    #10
  11. 4jonboy

    4jonboy Daughter of a 56 Recce

    Well done Otto.
    Been doing some searching on Google for some names and my posts for 56 Recce and I am very pleased to see the indexing working and picking up this wonderful site :)

    Lesley
     
    4jonboy, May 14, 2015
    #11
  12. von Poop

    von Poop Adaministrator Admin

    The GoogleBot also seems to be working it's way into corners it previously was not keen to mooch in.
    We took a giant hit when we changed forum software, from almost instantaneous indexing to frustratingly slow.
    Touching wood, but it really does look like things are getting back to normal at last. Some things indexed are only a few hours old, which is exactly what we want Google to be doing.

    Bing was indexing us normally the whole time.
    Does anyone actually use Bing?
     
    von Poop, May 14, 2015
    #12
  13. Drew5233

    Drew5233 #FuturePilot 1940 Obsessive

    When I open a window it opens to Google. If I click for another window to open by it's side it opens to Bing but I change the screen to Google
     
    Drew5233, May 14, 2015
    #13
  14. von Poop

    von Poop Adaministrator Admin

    I always admire your candid admissions.
     
    von Poop, May 14, 2015
    #14
  15. geoff501

    geoff501 Achtung Feind hört mit

    Not me. I heard Dave Crosby might use it
     
    geoff501, May 14, 2015
    #15
  16. PsyWar.Org

    PsyWar.Org Archive monkey

    Looking at the stats for my website for the whole of this year, Bing provided under 10% of the number of hits than Google did.
     
    PsyWar.Org, May 14, 2015
    #16
  17. Drew5233

    Drew5233 #FuturePilot 1940 Obsessive

    Thank you :D
     
    Drew5233, May 14, 2015
    #17
  18. geoff501

    geoff501 Achtung Feind hört mit

    1.7% Bing for me this year. Google well over 90.

    Chrome and Safari browser are at 28 and 22% respectively
     
    geoff501, May 14, 2015
    #18
  19. Fred Wilson

    Fred Wilson Member

    Message to the admin team. I can't begin to thank you enough.

    Secondly, it looks like one of my biggest concerns has been dealt with. That there is a succession plan in place for http://ww2talk.com/
    - and http://wwf.com/

    I have been quite concerned for sometime... "What if Otto gets hit by a bus?"
    The website and forum would cease to exist the day the annual renewal fee wasn't paid to http://www.invisionpower.com/
    Support: http://community.invisionpower.com/

    This forum is an incredible information source and resource. It needs to be safe and secure for generations to come.

    I think I am a happy guy today.
     
    Fred Wilson, May 14, 2015
    #19
    Buteman likes this.
  20. PsyWar.Org

    PsyWar.Org Archive monkey

    That's interesting Geoff, we're getting quite different results. My hits are 88.8% Google, 9.2% Bing, 0.5% Yandex, 0.4% Yahoo.

    Chrome 31.3%, Firefox 17.3%, Safari 15.1% and just 6.2% for MS Internet Explorer - how the mighty have fallen!
     
    PsyWar.Org, May 14, 2015
    #20
Page 1 of 2

Share This Page