Jump to content

TimurH

Members
  • Content count

    18
  • Donations

    0.00 CAD 
  • Joined

  • Last visited

Community Reputation

2 Neutral

About TimurH

  • Rank
    Peon
  • Birthday 05/21/1980

Contact Methods

  • Website URL
    http://cgru.info/

Personal Information

  • Name
    Timur
  • Location
    Russia, Korolev
  1. Afanasy - Free Render Farm Manager

    Hi. Now Afanasy got a common forum: http://forum.cgru.info/viewforum.php?f=19
  2. Distributing sims with afanasy

    Hi. Since 2.2.0 ( 2016.11.23 ) Afanasy can distribute sim slices: http://cgru.info/changes_log#release220
  3. Afanasy - Free Render Farm Manager

    As for AVOIDING HOSTS: If task finished with an error on some host, the host is pushed to an error hosts list. Each job block and task has such list. If the same host produced more that 3 errors, job (task) will avoid it. This value (3) can be customized for each job. By default it is "-1" for jobs, in this case this value taken from user. The default value for user is 3 and can be customized too. You can reset this list from GUI - "Reset Error Hosts" item in a job RMB menu.
  4. Afanasy - Free Render Farm Manager

    Hi. Sorry for a long delay, but i am visiting this forum just periodically. You can ask questions on github, where the source code is hosted: https://github.com/CGRU/cgru/issues?direction=desc&sort=updated&state=open Now i making forum based on RULES web engine (it is a project tracker in CGRU (for now young and simple project tracker)) http://cgru.info/rules/#/Ask_Questions_Here/AFANASY ( soon i'll try to attract all users there, and github will be only for working source code ) btw http://cgru.info/ site (where is Contacts page) was not work for about a week for about a half of the world, now it moved to another server and should work for everybody
  5. Afanasy - Free Render Farm Manager

    CGRU v2 released Major cghanges in latest releases (since last post here): - CGRU GitHub project started. - New site cgru.info. - Afanasy server is available for MS Windows OS. - JSON protocol. Python API is the same, but now it just helps to constuct a valid JSON objects and send them. - Web GUI. Online demo. - All config files are based on JSON too. - Automatic Wake-On-Lan. - Automatic Nimby and Free depends on CPU percentage for some time. - CGRU Keeper to launch all it's tools and any other configured. - Python 3 full support (Keeper and Movie Maker PyQt/PiSide, Afanasy job API, task services and parsers on a render client side). - Task output parser can return activity parameter, GUIs will show and update it along with percentage (for example when stereo it can show left or right eye is processing). - Thumbnails: Task output parser can recognize output image(s) and generate thumbnails with a configurable command. - Afanasy server events: server can generate an event (for example job error or done) and push a task in a system job with all uts data. Client has a special service for it, it can constuct a command from event data (it also includes job user data) and launch this command. For you can configure afanasy to send emails on job done and error. - RULES: Another big project started in CGRU and it will be the main its part. Online demo. It is a project tracker. It has Web GUI and keeps all data on a file server along with projects/scenes/shots/sequences on a file server. There is no need to fill in RULES with projects/shots. Just describe where projects are located and what the structure is, rules how to find scenes, shots, sources and output. So it name comes out hee: describe rules - navigate file server. The project in its beginig but it already can: - Navigate projects, scenes, shots on a file server. This navigation will update thumbnails, show latest result sequences and movies. Helps artists to find sources. - Define tasks, assign artists on shots, place comments. Mark shots with any defined tags (key, cleanup, full3d, done, error, any custom). Specify percentage, see average percentage for scene/project. - Artists receive new (comments) for shots they assigned and any other they interested in and have subscribed. - Create Dailies: RULES always knows what is a project, scene, shot, company, logged user and so on. Simple clicking on sequence in output it sends a job in Afanasy. It annotate images (project, shot, version, artist, comments and so on), encode a movie and place it in a special location. Later RULES shows dailies (all or latest) for each shot. - Convert movies to other format, codec, fps, explode to images sequence. All can be done parallel via Afanasy. - View, annotate, comment jpeg sequences via a special web player. - Process any custom operations (commands) with files and folders via Afanasy. ( in Cinelab it also copying huge files and generates md5 ) Globally RULES is a web engine. It navgates a special folders stucture, collencts hierarchical data. Data can contain rules where to find a special assets, how to show them, change them. There is a 4 ready assets designed specially for CG VFX: Project, Scenes, Scene, Shot. But you can do anything on RULES web engine. Here is a forum asset for RULES, you can ask questions there. In our company we have a special RULES servers that just copy huge files, generate md5.
  6. Afanasy - Free Render Farm Manager

    Version 1.5.0 released. Last enhancements: System Job: Post commands are executed by a special system job. You can control it like any other common job. Post commands usually used to cleanup temporary files on job deletion. Errors Forgive Time: You can configure a time form last host error to exclude it from error (avoid) hosts list. Job Lifetime: Jobs can be deleted automatically after some time. Farm Services Limits: You can describe maximum tasks type (services) starts on all clients. Needed for software licenses. Python 3: You can construct and send jobs using Python 3. Maximum Tasks Per Host: Job will never start tasks on the same host above this limit. No matter how much free capacity it has. Sub-task Dependence: Tasks can depend on other task(s) sub-progress. They can run when some task finished partially. It is useful to render simulations. As simulations usually performed by a single task on a whole frame range. Now render tasks can run when the entire simulation is not finished. Houdini Submission Improvements: You can connect several Afanasy and other ROP nodes together to describe a complex job with dependences between ROPs. This job consists of a simulation with sub-task dependence. Two caches waiting the simulation, but cat run independently from each other. Mantra tile render which produces three blocks which wait all the cache. Two blocks for preview which can run independently but wait tile render tasks. One to convert EXR files to JPEGs and one to generate a preview movie form EXRs.
  7. Afanasy - Free Render Farm Manager

    Version 1.3.0 released. Last enhancements: Paths Map: Every client can describe how to translate its local paths to 'server' paths. On jobs send client translates all paths to 'server'. When client receives a task from server it translates all paths from 'sever' to local. With this feature you can setup Multi-OS render farm (and workstations). An artist can submit a job from any OS and it can be rendered on all OS-es. Python output filters(parsers) can produce error or warning. During output parsing you can find any error message and stop render process if it still running. Disk IO operations meter. Custom render host resource(s) meter(s). You can describe any resource meter by Python class and GUI will plot the graph. Lost of bug-fixes for MS Windows. Windows clients and GUI has the same functionality as Linux version. But there is still no server for MS Windows. Windows Must Die: You can list windows names in a file. Render will search windows with specified names and close them (sends WM_CLOSE signal). It is useful for MS Windows farm, as this OS when something going wrong often raise messages with "apologizes" which can hang render process until somebody press OK button. File "windowsmustdie.txt" example: mantra.exe mantra.exe - Application Error Movies creation tools. GUI and command line tools which can create 'Dailies' with special annotations and slate frame. http://cgru.sourceforge.net/utilities/moviemaker/doc/index.html You can render movies locally or send jobs to Afanasy farm. This tools are written on Python, GUI - PyQt, frame annotation - ImageMagick, encoding - ffmpeg. SoftImage XSI and 3D Studio MAX submission scripts. Every client sends version to server. GUI show clients versions. This version is a simple 'versions.txt' file contents and may be customized as you want.
  8. Afanasy ( email acknowledgement )

    Nice wish list ) I think i'll improve Afanasy Python API. When task came to remote host, this render host instance some Python class with some initial parameters. Before task start 'pre' method will be called (by this render), with some parameters. After task finish 'post' method will be called. This post method can send emails, insert data in your statistics database, or even can check something and switch task state error. It will be useful i hope. I am thinking about how to specify where to store any custom parameters you want to pass to this class. "list of machines which failed to render and mark it as failed would be better to see which systems are giving the failed renders..." - Afanasy already stores 'blask lists' - error hosts for each block and each task. Host name last task session was, and a log what, where and when was happen with task. - But it all only in server RAM, it does not store it anywhere else. You can query it in 'Watch' GUI.
  9. Afanasy ( email acknowledgement )

    I thinking about some command which can be executed with some identifiers (user, job, task, status), for sending emails, for example. Some people wants me to realize it in Afanasy (and I'll do it). Or you want each task to have a commands to execute on success or fail? For example our developers wrote python scripts to launch our working soft through. We launch Houdini and Nuke which render frame(s) locally in some 'temp' directory, then copy result on file server and clean 'temp' (it saves some traffic). So you can launch any custom things you wrote, not to launch Nuke or Houdini directly.
  10. Afanasy - Free Render Farm Manager

    Last enhancements: Watch (Afanasy GUI) now uses "Qt Model/View Programming" - it allows to navigate jobs with 1 000 000 tasks. Multiply Tasks Renders: Render can run several tasks at the same time. Capacity mechanism: Each host and task has a capacity value. Task checks available (free) capacity on render, and if its enough, task launches and take its capacity value from render. Useful for farm with hosts and tasks with different "power". More powerful machine can run more tasks. More lite tasks can be executed on one machine. More balanced farm resources usage. No time wasting (time wasting may happen when client run some lite task which take no resources, but can't do to something else simultaneity, as server interpret it as "busy" or "free" only, server does not understand how much client busy). Tasks can variate capacity 'on-the-fly': Capacity variation can be described through its minimum and maximum coefficients (or may be simple constant). If task with 1000 capacity units runs on render with 4000 free capacity, task can take capacity coefficient 4. This coefficient can be caught in task command line (so Mantra can be launched 'mantra -j 4 ...', or 3000 capacity can be used by one 'houdini' task, for example to generate something, which use only one CPU, and 'mantra -j 3'). Hosts capacity values described in 'Farm Setup' ('xml' file).
  11. Afanasy ( email acknowledgement )

    + Afanasy has a very simple web based GUI. It allows only to watch statuses, not to change anything (for security reasons it may not be able to change anything). And it is very raw now. But "It works." (Excuse my english if mistakes)
  12. Afanasy ( email acknowledgement )

    No, Afanasy can't do it (yet). But I am thinking about it. It not so hard to make it. For example Afanasy can execute a command with environment variables contains job name, task name, user name, ... etc. Command can be described in Afanasy XML config file. Simple python program, sending emails can be provided as an example. Who must execute command server or render host? Launching such commands on remote host can save server resources. Where email addresses will be stored, in Afanasy database? And whose attribute (address) it must be? Job or User? May be each user can have an address, and any job can override it. May be better not to store addresses, store commands to execute on task|job status change. This commands can contain anything and do anything.
  13. Afanasy - Free Render Farm Manager

    Words spelling corrected (by a program). HTML mistakes fixed ( pages validated at "http://validator.w3.org").
×