Missing Texture file

My 'Daz Content' SSD misbahving so I had to format it.
I reimported all the content from a backup taken last night but now Daz can't find the texture files.
The file structure and content is exactly the same on the backup (even the name of the SDD) so it shouldn't be an issue of Daz looking in the wrong place for the information. And all my stuff from Rendo is working perfectly with no missing texture problems - it's got it's own folder but still on the same SSD with the Daz content.
When I look in the texture folder (where it says things are missing) it's all there where I'd expect them to be.
Smart content is also missing all thumbnail imagery except for the very top level (character image on the folder is visible, but figure/mats/etc within the folder all show the warning exclamation mark).
I'm confused about what has gone wrong because I moved everything to a different SSD once before and had no problems. This isn't even a different SSD and it's all gone wrong.
Comments
I'm now getting the message,
'A valid PostgreSQL connection could not be established...'
I'm sure this didn't come up a few minutes ago.
Did you install PostgreSQL? Are you sure you have the same folders set as content directories?
Hi Richard,
The PostgreSQL, I've tried uninstalling it and installing it again but it doesn't make a difference. It still doesn't load at start-up. And the Start CMS button (bottom left of my smart content window) doesn't help eithers.
I've solved the texture issue. For anyone that might encounter this when messing around with content on externals, be careful not to re-format your drive with the 'case-sensitive' option, this will cause problems.
I also tried re-installing the PostgreSQL after fixing this problem but still no luck.
I took a backup of the DAZ 3D folder within my Mac's Application Support folder yesterday. I can see a lot of differences between the backup and what I have now in the live folder. I haven't made changes to these Mac Library folders so I don't see why they should have been affected by me moving only the content folder which is on an the external.
The backup folder contains three additional folders/files: dson, dzinstall.ini, InstallManager
The two remaining folders within the 'live' Application Support folder: CMS and Studio4 contain only one item each.
The backup versions of these two folders contains a lot more stuff.
cms contain a ContentCluster folder.
Studio4 contains about 20 extra items.
I've tried replacing the whole DAZ 3D folder in Application Support with my backup version but it still didn't fix the failed PostgreSQL, so I put it back so I don't make it worse.
Check permissions on the Content Cluster folder.
Read + Write for all users.
Within Daz Studio, 'Preferences > CMS Settings > Cluster Directory', 'None' is selected. I've tried changing it but it won't accept changes and reverts to 'None'.
Does the port matter? I'm certain that the port number is different now, I went through all the preferences and remember a 5 digit number, now it's only 4 digits. It won't accpet changes to that either.
Hello,
this sounds like a tricky problem indeed. Which version of OS X and which version of DS are you running?
Was the misbehaving SSD doing as it the CMS (Content Manager System) is doing now, or what it something else? Trying to establish if the CMS was wonky then too or not.
Did you check permissions on the cms folder that holds the Content Cluster folder? That should contain a cmscfg.json file (and nothing else) - it sounds as if your DS is unable to create that and so can't store its settings
Hi Totte, thank you for helping,
Mac is running Sierra 10.12.5
Daz Studio is version 4.9.4.117 Pro Edition 64bit.
No, everything was working perfectly within Daz but the SSD wouldn't eject properly, and it started failing when I tried to copy other files.
I retrieved all the Daz content and took a backup of the Daz folder from 'Applications' and the Daz folder from 'Application Support' (on the Mac's internal SSD) in case something went wrong, I formatted the 'content' drive, put the content back (exacly as it was before) and I had the first problem where Daz couldn't find the texture files.
Then I tried resetting the database and reimporting the metadata but it didn't fix it.
I realised I'd formatted the drive as 'case-sensitive', so I formatted it again and put all the content back on.
Now all my content worked fine (textures path problem was fixed) but my CMS was not working - PostgreSQL warning at startup, so I restored the Daz folder in Applications and the Daz folder in Application Support that I'd taken. That didn't fix it.
I tried removing PostgreSQL through DIM and reinstalling it but it made no difference.
As that didn't work, I have reverted Applications + Application Support with the backup again.
I can see that Daz isn't looking at the 'Cluster' folder but it won't allow me to change it, I've tried several times and it won't 'Apply' the change, and the same with the port.
The 'cms' folder (Mac > Library > Application Support > DAZ 3D > cms) has Read + Write permissions.
Within it is two things:
One is the file cmscfg.json which has Read + Write permissions.
The other is a folder 'ContentCluster' (Read + Write) which has 19 items in there, files and folders.
Thanks for your help also Richard
OK,
When you formatted the content drive, did you give it exactly the same name as before? (So it mounts at the same path, /Volumes/<diskname>)?
Does DIM find the content cluster?
do you have a logfile in the content cluster folder named ''dblog.txt'?
Does it say anything of interest in at the end?
Yes, I gave it the same name as before.
How do I check if DIM can find the content cluster?
Yes, I have that file (I removed my name), it says:
FATAL: pg_hba.conf rejects connection for host "[local]", user "...", database "postgres", SSL off
LOG: received smart shutdown request
LOG: autovacuum launcher shutting down
LOG: shutting down
LOG: database system is shut down
LOG: database system was shut down at 2017-07-14 14:40:37 BST
LOG: database system is ready to accept connections
LOG: autovacuum launcher started
FATAL: pg_hba.conf rejects connection for host "[local]", user "...", database "postgres", SSL off
LOG: received smart shutdown request
LOG: autovacuum launcher shutting down
LOG: shutting down
LOG: database system is shut down
FATAL: data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
DETAIL: Permissions should be u=rwx (0700).
FATAL: data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
DETAIL: Permissions should be u=rwx (0700).
FATAL: data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
DETAIL: Permissions should be u=rwx (0700).
FATAL: data directory "/Users/.../Library/Application Support/DAZ 3D/cms/ContentCluster" has group or world access
DETAIL: Permissions should be u=rwx (0700).
This is just the end of the log file, copied from the last date that is shown. I think the 'fatal...SSL off' is where I opened Daz and forgot to connect the SSL that contains the content folder (I do that often). I don't understand why that happens though, as only the content is stored on the external.
I don't know what the 'Fatal...Permissions' means.
This is from the log file within Daz Studio:
2017-07-16 16:13:29.214 A valid PostgreSQL CMS connection could not be established. Several DAZ Studio features that require a valid PostgreSQL CMS connection, such as context aware content views and loading content installed using the Daz Connect service, will not be available. Check your network, anti-virus, and firewall settings for conflicts.
2017-07-16 16:13:29.226 WARNING: /src/sdksource/cloud/dzcloudtasknotifier.cpp(178): Unexpected exception in CloudFIle::lookupFromDb: Unable to connect to the database
This means the permissions is wrong:
start the terminal
do: cd <and drag the cms folder to terminal to get the correct path>
do (set user only access): sudo chmod -R 700 ContentCluster/
now do: cd ContentCluster
then do. ls -ls
Should look like (but your user as owner=
8 -rwx------ 1 totte staff 4 16 Maj 2014 PG_VERSION
0 drwx------ 7 totte staff 238 18 Apr 2015 base
216 -rwx------ 1 totte staff 109786 14 Jul 11:14 dblog.txt
0 drwx------ 44 totte staff 1496 14 Jul 10:48 global
0 drwx------ 12 totte staff 408 24 Apr 2016 pg_clog
I get this...
Me-MBP:ContentCluster Mer$ ls -ls
total 408
8 -rwx------ 1 Me admin 4 4 Apr 05:00 PG_VERSION
0 drwx------ 7 Me admin 238 14 Jul 23:48 base
320 -rwx------ 1 Me admin 161830 14 Jul 14:42 dblog.txt
0 drwx------ 44 Me admin 1496 14 Jul 14:45 global
0 drwx------ 3 Me admin 102 14 Jul 14:45 pg_clog
16 -rwx------ 1 Me admin 4469 4 Apr 05:00 pg_hba.conf
8 -rwx------ 1 Me admin 1636 4 Apr 05:00 pg_ident.conf
0 drwx------ 5 Me admin 170 14 Jul 23:48 pg_multixact
0 drwx------ 3 Me admin 102 14 Jul 14:45 pg_notify
0 drwx------ 2 Me admin 68 14 Jul 14:45 pg_serial
0 drwx------ 2 Me admin 68 14 Jul 14:45 pg_snapshots
0 drwx------ 6 Me admin 204 14 Jul 14:45 pg_stat
0 drwx------ 2 Me admin 68 14 Jul 14:45 pg_stat_tmp
0 drwx------ 3 Me admin 102 14 Jul 14:45 pg_subtrans
0 drwx------ 2 Me admin 68 14 Jul 14:45 pg_tblspc
0 drwx------ 2 Me admin 68 14 Jul 14:45 pg_twophase
0 drwx------ 14 Me admin 476 14 Jul 23:48 pg_xlog
48 -rwx------ 1 Me admin 20644 4 Apr 05:00 postgresql.conf
8 -rwx------ 1 Me admin 123 14 Jul 14:41 postmaster.opts
Me-MBP:ContentCluster Me$
Is that ok?
My username is my full name so I've replaced it with 'Me' in the text above.
When I check the ContentCluster folder it now shows Read + Write access for 'Me' as user.
'Everyone' has 'No Access'.
'Admin' has disappeared completely.
It still gives the 'PostgreSQL connection could not be established' when Daz Studio starts up.
Does rhe cms start now?
If you run DS to start it, does the log say different things compared to before?
No, it all seems the same as before.
Daz Log says:
2017-07-16 21:13:27.925 A valid PostgreSQL CMS connection could not be established. Several DAZ Studio features that require a valid PostgreSQL CMS connection, such as context aware content views and loading content installed using the Daz Connect service, will not be available. Check your network, anti-virus, and firewall settings for conflicts.
2017-07-16 21:13:27.936 WARNING: /src/sdksource/cloud/dzcloudtasknotifier.cpp(178): Unexpected exception in CloudFIle::lookupFromDb: Unable to connect to the database
It says the final paragraph about 20 times, over and over.
dblog.txt has not changed at all, unlike the log above, it doesn't even show a more recent entry to it's log.
Not sure if this is important but...
In Daz Studio, I rechecked Preferences > CMS Settings (tab).
It still shows Cluster Directory: None
And it still won't allow me to apply a change to this. I clicked 'Apply', then 'Accept' and it reverts to 'None'.
Hmm, so DS still cant find it, i need to figure that one out.. I'll be back
Thank you.
Yes, it seems that Daz can't find it at all. I really don't understand this because it hasn't been moved, it's on my Mac's internal SSD. It was only the external SSD that holds the content that had a problem.
In my cms folder there is a file named cmscfg.json, it contains the info, mine says:
{
"Port" : 17237,
"DatabaseClusterPath" : "/Users/totte/Library/Application Support/DAZ 3D/cms"
}
Yes, mine too, it says exactly the same (different user obviously).
This looks to me like the information that should be in the Daz Studio > Preferences > CMS Settings (tab).
At present this tab, within Daz Studio Preferences, says the ContentCluster directory path is 'None' and the Port is 1024.
But it will not allow me to 'Apply' the change with Preferences so I'm stuck.
Somehow it looks like Daz Studio is unable/unwilling to look in this 'CMS' folder at all, if it was looking in here then it should read that file and then it would have the correct path/port for the ContentCluster.
I've got no idea why it's not reading it or how to fix it though. Somewhere there must be a path that should be directing the entire CMS to this folder but isn't at the moment.
Hmm,
@Richard: Can you advice where to set that?
I've opened up DIM and clicked the little arrow on PostgreSQL to 'show installed files...'
If I click on the top item, which is:
/DAZ 3D/CMS/cmscfg.json
It take me to this location where the file is:
Macintosh HD > Library > Application Support > DAZ 3D > cms > cmscfg.json
It states:
{
"Port" : 17237,
"DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"
}
I can also find that same file at:
Macintosh HD > Users > MyName > Library > Application Support > DAZ3D > cms > cmscfg.json
It states the same:
{
"Port" : 17237,
"DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"
}
Both files contain the exact same information but they are TWO COPIES of the same file, I edited one by adding a character and saved it, then I checked the file in both locations.
In one location it showed the edit that I had just made, in the other location it was not edited.
Maybe this is the problem?
According to DIM, the file is here: Macintosh HD > Library > Application Support > DAZ 3D > cms > cmscfg.json
But the file is then telling Daz something different: "DatabaseClusterPath" : "/Users/MyName/Library/Application Support/DAZ 3D/cms"
I might be misundering this completely. It might not be relevant, maybe it was caused by me trying to uninstall and reinstall PostgreSQL, or maybe the permissions change we tried yesterday, I don't know.
And if this is the problem, I still don't know how to fix it
What modification dates do you have on the files, i.e. which is the newer one?
I think you can tell DIM when install Postgres where to install it, if I'm not totoally lost (was a long time since I reinstalled it)
@Richard Haseltine: Any ideas?
They both have the same date for creation (last year sometime).
One has the modification date the same as the creation date.
The other has the modification date as today - because I edited it to see if the change appeared on both.
DIM Log says, it's connecting to:
Application Data:
Location = /Users/MyName/Library/Application Support/DAZ 3D/InstallManager
But if I click on PostgreSQL in DIM is says that it's 'installed files' are in:
Macintosh HD > Library > Application Support > DAZ3D > cms
Shouldn't these be the same path, and both under my username?
DIM log also says:
Make sure the server address and port number are correct.
Error connecting to CMS
Hmm,
I looked at my install here (on my laptop, not home with the monsters though), and the config in /Library seems to be outdated and the one in ~/Library sems to be the one that is used, but I cannot find if there is a cfg file that tells DS where to look for the cms directory.
When you start DS, and look in the Activity Monitor of OS X (sort as process and subprocess, do you see any postgres processes under DS?