Missing Texture file

supernoobsupernoob Posts: 154

My 'Daz Content' SSD misbahving so I had to format it.

I reimported all the content from a backup taken last night but now Daz can't find the texture files.

The file structure and content is exactly the same on the backup (even the name of the SDD) so it shouldn't be an issue of Daz looking in the wrong place for the information. And all my stuff from Rendo is working perfectly with no missing texture problems - it's got it's own folder but still on the same SSD with the Daz content.

When I look in the texture folder (where it says things are missing) it's all there where I'd expect them to be.

Smart content is also missing all thumbnail imagery except for the very top level (character image on the folder is visible, but figure/mats/etc within the folder all show the warning exclamation mark).

I'm confused about what has gone wrong because I moved everything to a different SSD once before and had no problems. This isn't even a different SSD and it's all gone wrong.

Post edited by supernoob on
«1

Comments

  • supernoobsupernoob Posts: 154

    I'm now getting the message,

    'A valid PostgreSQL connection could not be established...'

    I'm sure this didn't come up a few minutes ago.

  • Richard HaseltineRichard Haseltine Posts: 102,805

    Did you install PostgreSQL? Are you sure you have the same folders set as content directories?

  • supernoobsupernoob Posts: 154
    edited July 2017

    Did you install PostgreSQL? Are you sure you have the same folders set as content directories?

    Hi Richard,

    The PostgreSQL, I've tried uninstalling it and installing it again but it doesn't make a difference. It still doesn't load at start-up. And the Start CMS button (bottom left of my smart content window) doesn't help eithers.

    I've solved the texture issue. For anyone that might encounter this when messing around with content on externals, be careful not to re-format your drive with the 'case-sensitive' option, this will cause problems.

    I also tried re-installing the PostgreSQL after fixing this problem but still no luck.

    Post edited by supernoob on
  • supernoobsupernoob Posts: 154
    edited July 2017

    I took a backup of the DAZ 3D folder within my Mac's Application Support folder yesterday. I can see a lot of differences between the backup and what I have now in the live folder. I haven't made changes to these Mac Library folders so I don't see why they should have been affected by me moving only the content folder which is on an the external.

    The backup folder contains three additional folders/files: dson, dzinstall.ini, InstallManager

    The two remaining folders within the 'live' Application Support folder: CMS and Studio4 contain only one item each.
    The backup versions of these two folders contains a lot more stuff.
    cms contain a ContentCluster folder.
    Studio4 contains about 20 extra items.

    I've tried replacing the whole DAZ 3D folder in Application Support with my backup version but it still didn't fix the failed PostgreSQL, so I put it back so I don't make it worse.

    Post edited by supernoob on
  • Richard HaseltineRichard Haseltine Posts: 102,805

    Check permissions on the Content Cluster folder.

  • supernoobsupernoob Posts: 154
    edited July 2017

    Check permissions on the Content Cluster folder.

     

    Read + Write for all users.

    Post edited by supernoob on
  • supernoobsupernoob Posts: 154
    edited July 2017

    Check permissions on the Content Cluster folder.

     

    Within Daz Studio, 'Preferences > CMS Settings > Cluster Directory', 'None' is selected. I've tried changing it but it won't accept changes and reverts to 'None'.

    Does the port matter? I'm certain that the port number is different now, I went through all the preferences and remember a 5 digit number, now it's only 4 digits. It won't accpet changes to that either.

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    Hello,

    this sounds like a tricky problem indeed. Which version of OS X and which version of DS are you running?

    Was the misbehaving SSD doing as it the CMS (Content Manager System) is doing now, or what it something else? Trying to establish if the CMS was wonky then too or not.

     

  • Richard HaseltineRichard Haseltine Posts: 102,805

    Did you check permissions on the cms folder that holds the Content Cluster folder? That should contain a cmscfg.json file (and nothing else) - it sounds as if your DS is unable to create that and so can't store its settings

  • supernoobsupernoob Posts: 154
    edited July 2017
    Totte said:

    Hello,

    this sounds like a tricky problem indeed. Which version of OS X and which version of DS are you running?

    Was the misbehaving SSD doing as it the CMS (Content Manager System) is doing now, or what it something else? Trying to establish if the CMS was wonky then too or not.

     

     

    Hi Totte, thank you for helping,

    Mac is running Sierra 10.12.5
    Daz Studio is version 4.9.4.117 Pro Edition 64bit.

    No, everything was working perfectly within Daz but the SSD wouldn't eject properly, and it started failing when I tried to copy other files.
    I retrieved all the Daz content and took a backup of the Daz folder from 'Applications' and the Daz folder from 'Application Support' (on the Mac's internal SSD) in case something went wrong, I formatted the 'content' drive, put the content back (exacly as it was before) and I had the first problem where Daz couldn't find the texture files.

    Then I tried resetting the database and reimporting the metadata but it didn't fix it.
    I realised I'd formatted the drive as 'case-sensitive', so I formatted it again and put all the content back on.

    Now all my content worked fine (textures path problem was fixed) but my CMS was not working - PostgreSQL warning at startup, so I restored the Daz folder in Applications and the Daz folder in Application Support that I'd taken. That didn't fix it.
    I tried removing PostgreSQL through DIM and reinstalling it but it made no difference.
    As that didn't work, I have reverted Applications + Application Support with the backup again.

    I can see that Daz isn't looking at the 'Cluster' folder but it won't allow me to change it, I've tried several times and it won't 'Apply' the change, and the same with the port.

    Post edited by supernoob on
  • supernoobsupernoob Posts: 154
    edited July 2017

    Did you check permissions on the cms folder that holds the Content Cluster folder? That should contain a cmscfg.json file (and nothing else) - it sounds as if your DS is unable to create that and so can't store its settings

    The 'cms' folder (Mac > Library > Application Support > DAZ 3D > cms) has Read + Write permissions.

    Within it is two things:
    One is the file cmscfg.json which has Read + Write permissions.
    The other is a folder 'ContentCluster' (Read + Write) which has 19 items in there, files and folders.

    Thanks for your help also Richard

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    OK, 

    When you formatted the content drive, did you give it exactly the same name as before? (So it mounts at the same path, /Volumes/<diskname>)?

    Does DIM find the content cluster?

    do you have a logfile in the content cluster folder named ''dblog.txt'?

    Does it say anything of interest in at the end?

     

  • supernoobsupernoob Posts: 154
    edited July 2017
    Totte said:

    OK, 

    When you formatted the content drive, did you give it exactly the same name as before? (So it mounts at the same path, /Volumes/<diskname>)?

    Does DIM find the content cluster?

    do you have a logfile in the content cluster folder named ''dblog.txt'?

    Does it say anything of interest in at the end?

     

    Yes, I gave it the same name as before.

    How do I check if DIM can find the content cluster?

     

    Yes, I have that file (I removed my name), it says:

    FATAL:  pg_hba.conf rejects connection for host "[local]", user "...", database "postgres", SSL off
    LOG:  received smart shutdown request
    LOG:  autovacuum launcher shutting down
    LOG:  shutting down
    LOG:  database system is shut down
    LOG:  database system was shut down at 2017-07-14 14:40:37 BST
    LOG:  database system is ready to accept connections
    LOG:  autovacuum launcher started
    FATAL:  pg_hba.conf rejects connection for host "[local]", user "...", database "postgres", SSL off
    LOG:  received smart shutdown request
    LOG:  autovacuum launcher shutting down
    LOG:  shutting down
    LOG:  database system is shut down
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).

    This is just the end of the log file, copied from the last date that is shown. I think the 'fatal...SSL off' is where I opened Daz and forgot to connect the SSL that contains the content folder (I do that often). I don't understand why that happens though, as only the content is stored on the external.

    I don't know what the 'Fatal...Permissions' means.

    Post edited by supernoob on
  • supernoobsupernoob Posts: 154

    This is from the log file within Daz Studio:

    2017-07-16 16:13:29.214 A valid PostgreSQL CMS connection could not be established.  Several DAZ Studio features that require a valid PostgreSQL CMS connection, such as context aware content views and loading content installed using the Daz Connect service, will not be available.  Check your network, anti-virus, and firewall settings for conflicts.
    2017-07-16 16:13:29.226 WARNING: /src/sdksource/cloud/dzcloudtasknotifier.cpp(178): Unexpected exception in CloudFIle::lookupFromDb: Unable to connect to the database

  • TotteTotte Posts: 14,099
    supernoob said:

    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700)

    This means the permissions is wrong:
    start the terminal

    do: cd  <and drag the cms folder to terminal to get the correct path>

    do  (set user only access): sudo chmod -R 700 ContentCluster/

    now do: cd ContentCluster

    then do. ls -ls

    Should look like (but your user as owner=

      8 -rwx------   1 totte  staff       4 16 Maj  2014 PG_VERSION

      0 drwx------   7 totte  staff     238 18 Apr  2015 base

    216 -rwx------   1 totte  staff  109786 14 Jul 11:14 dblog.txt

      0 drwx------  44 totte  staff    1496 14 Jul 10:48 global

      0 drwx------  12 totte  staff     408 24 Apr  2016 pg_clog

     

     

  • supernoobsupernoob Posts: 154
    edited July 2017
    Totte said:
    supernoob said:

    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700).
    FATAL:  data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
    DETAIL:  Permissions should be u=rwx (0700)

    This means the permissions is wrong:
    start the terminal

    do: cd  <and drag the cms folder to terminal to get the correct path>

    do  (set user only access): sudo chmod -R 700 ContentCluster/

    now do: cd ContentCluster

    then do. ls -ls

    Should look like (but your user as owner=

      8 -rwx------   1 totte  staff       4 16 Maj  2014 PG_VERSION

      0 drwx------   7 totte  staff     238 18 Apr  2015 base

    216 -rwx------   1 totte  staff  109786 14 Jul 11:14 dblog.txt

      0 drwx------  44 totte  staff    1496 14 Jul 10:48 global

      0 drwx------  12 totte  staff     408 24 Apr  2016 pg_clog

     

     

     

    I get this...

    Me-MBP:ContentCluster Mer$ ls -ls

    total 408

      8 -rwx------   1 Me  admin       4  4 Apr 05:00 PG_VERSION

      0 drwx------   7 Me  admin     238 14 Jul 23:48 base

    320 -rwx------   1 Me  admin  161830 14 Jul 14:42 dblog.txt

      0 drwx------  44 Me  admin    1496 14 Jul 14:45 global

      0 drwx------   3 Me  admin     102 14 Jul 14:45 pg_clog

     16 -rwx------   1 Me  admin    4469  4 Apr 05:00 pg_hba.conf

      8 -rwx------   1 Me  admin    1636  4 Apr 05:00 pg_ident.conf

      0 drwx------   5 Me  admin     170 14 Jul 23:48 pg_multixact

      0 drwx------   3 Me  admin     102 14 Jul 14:45 pg_notify

      0 drwx------   2 Me  admin      68 14 Jul 14:45 pg_serial

      0 drwx------   2 Me  admin      68 14 Jul 14:45 pg_snapshots

      0 drwx------   6 Me  admin     204 14 Jul 14:45 pg_stat

      0 drwx------   2 Me  admin      68 14 Jul 14:45 pg_stat_tmp

      0 drwx------   3 Me  admin     102 14 Jul 14:45 pg_subtrans

      0 drwx------   2 Me  admin      68 14 Jul 14:45 pg_tblspc

      0 drwx------   2 Me  admin      68 14 Jul 14:45 pg_twophase

      0 drwx------  14 Me  admin     476 14 Jul 23:48 pg_xlog

     48 -rwx------   1 Me  admin   20644  4 Apr 05:00 postgresql.conf

      8 -rwx------   1 Me  admin     123 14 Jul 14:41 postmaster.opts

    Me-MBP:ContentCluster Me$

     

    Is that ok?

    My username is my full name so I've replaced it with 'Me' in the text above.

    When I check the ContentCluster folder it now shows Read + Write access for 'Me' as user.
    'Everyone' has 'No Access'.
    'Admin' has disappeared completely.

    It still gives the 'PostgreSQL connection could not be established' when Daz Studio starts up.

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    Does rhe cms start now?
    If you run DS to start it, does the log say different things compared to before?

  • supernoobsupernoob Posts: 154
    edited July 2017
    Totte said:

    Does rhe cms start now?
    If you run DS to start it, does the log say different things compared to before?

     

    No, it all seems the same as before.

    Daz Log says:

    2017-07-16 21:13:27.925 A valid PostgreSQL CMS connection could not be established.  Several DAZ Studio features that require a valid PostgreSQL CMS connection, such as context aware content views and loading content installed using the Daz Connect service, will not be available.  Check your network, anti-virus, and firewall settings for conflicts.

    2017-07-16 21:13:27.936 WARNING: /src/sdksource/cloud/dzcloudtasknotifier.cpp(178): Unexpected exception in CloudFIle::lookupFromDb: Unable to connect to the database

    It says the final paragraph about 20 times, over and over.

     

    dblog.txt has not changed at all, unlike the log above, it doesn't even show a more recent entry to it's log.

    Post edited by supernoob on
  • supernoobsupernoob Posts: 154
    edited July 2017

    Not sure if this is important but...

    In Daz Studio, I rechecked Preferences > CMS Settings (tab).

    It still shows Cluster Directory: None

    And it still won't allow me to apply a change to this. I clicked 'Apply', then 'Accept' and it reverts to 'None'.

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    Hmm, so DS still cant find it, i need to figure that one out.. I'll be back

  • supernoobsupernoob Posts: 154
    Totte said:

    Hmm, so DS still cant find it, i need to figure that one out.. I'll be back

     

    Thank you.

    Yes, it seems that Daz can't find it at all. I really don't understand this because it hasn't been moved, it's on my Mac's internal SSD. It was only the external SSD that holds the content that had a problem.

  • TotteTotte Posts: 14,099

    In my cms folder there is a file named cmscfg.json, it contains the info, mine says:

    {
        "Port" : 17237,
        "DatabaseClusterPath" : "/Users/totte/Library/Application Support/DAZ 3D/cms"
    }

  • supernoobsupernoob Posts: 154
    edited July 2017
    Totte said:

    In my cms folder there is a file named cmscfg.json, it contains the info, mine says:

    {
        "Port" : 17237,
        "DatabaseClusterPath" : "/Users/totte/Library/Application Support/DAZ 3D/cms"
    }

     

    Yes, mine too, it says exactly the same (different user obviously).

    This looks to me like the information that should be in the Daz Studio > Preferences > CMS Settings (tab).
    At present this tab, within Daz Studio Preferences, says the ContentCluster directory path is 'None' and the Port is 1024.

    But it will not allow me to 'Apply' the change with Preferences so I'm stuck.

    Somehow it looks like Daz Studio is unable/unwilling to look in this 'CMS' folder at all, if it was looking in here then it should read that file and then it would have the correct path/port for the ContentCluster.

    I've got no idea why it's not reading it or how to fix it though. Somewhere there must be a path that should be directing the entire CMS to this folder but isn't at the moment.

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    Hmm, 

    @Richard: Can you advice where to set that?

  • supernoobsupernoob Posts: 154
    edited July 2017

    I've opened up DIM and clicked the little arrow on PostgreSQL to 'show installed files...'

    If I click on the top item, which is:
    /DAZ 3D/CMS/cmscfg.json
    It take me to this location where the file is:
    Macintosh HD > Library > Application Support > DAZ 3D > cms > cmscfg.json

    It states:

    {
        "Port" : 17237,
        "DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"
    }

     

    I can also find that same file at:
    Macintosh HD > Users > MyName > Library > Application Support > DAZ3D > cms > cmscfg.json

    It states the same:

    {
        "Port" : 17237,
        "DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"
    }

     

     

    Both files contain the exact same information but they are TWO COPIES of the same file, I edited one by adding a character and saved it, then I checked the file in both locations.
    In one location it showed the edit that I had just made, in the other location it was not edited.

    Maybe this is the problem?
    According to DIM, the file is here: Macintosh HD > Library > Application Support > DAZ 3D > cms > cmscfg.json
    But the file is then telling Daz something different: "DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"

    I might be misundering this completely. It might not be relevant, maybe it was caused by me trying to uninstall and reinstall PostgreSQL, or maybe the permissions change we tried yesterday, I don't know.

    And if this is the problem, I still don't know how to fix it frown

    Post edited by supernoob on
  • TotteTotte Posts: 14,099
    edited July 2017

    What modification dates do you have on the files, i.e. which is the newer one?
    I think you can tell DIM when install Postgres where to install it, if I'm not totoally lost (was a long time since I reinstalled it)

    Post edited by Totte on
  • TotteTotte Posts: 14,099

    @Richard Haseltine: Any ideas?

  • supernoobsupernoob Posts: 154
    Totte said:

    What modification dates do you have on the files, i.e. which is the newer one?
    I think you can tell DIM when install Postgres where to install it, if I'm not totoally lost (was a long time since I reinstalled it)

    They both have the same date for creation (last year sometime).

    One has the modification date the same as the creation date.

    The other has the modification date as today - because I edited it to see if the change appeared on both.

  • supernoobsupernoob Posts: 154
    edited July 2017

    DIM Log says, it's connecting to:
    Application Data:
        Location = /Users/MyName/Library/Application Support/DAZ 3D/InstallManager

    But if I click on PostgreSQL in DIM is says that it's 'installed files' are in:
    Macintosh HD > Library > Application Support > DAZ3D > cms

    Shouldn't these be the same path, and both under my username?

     

    DIM log also says:

    Make sure the server address and port number are correct.
    Error connecting to CMS

    Post edited by supernoob on
  • TotteTotte Posts: 14,099

    Hmm, 

    I looked at my install here (on my laptop, not home with the monsters though), and the config in /Library seems to be outdated and the one in  ~/Library sems to be the one that is used, but I cannot find if there is a cfg file that tells DS where to look for the cms directory.

    When you start DS, and look in the Activity Monitor of OS X (sort as process and subprocess, do you see any postgres processes under DS?

Sign In or Register to comment.