Sas file copy

->>>> Click Here to Download <<<<<<<-

Any help would be appreciated. Glad you're making use of the task. If you can turn on the additional logging see this note and then send me the resulting log file, I might be able to see what's going on. It could be a weird timing issue or a race condition, as the resolving of the macro variables happens in the background just before the task is run. You can send the log to me at chris. It will still come to me, as I'm the one who supports this task.

This is strange. On alternative days, I am not able to work on this addin. The 'Customs' folder where the dll is stored appears today, but is not seen tomorrow. But again the day after tomorrow it is seen. Would you be knowing why is this happening? When the Customs folder is not seen, a different icon is seen for the addin and I will not be able to work with the addin. Wow, I have no idea. Are you logging into a system that has a roaming Windows profile that might be different on alternative days?

You could enable logging use these instructions on the days where it's NOT working and send me the logging text file chris. Actually, if you do that, send me a log from a day where it IS working as well -- so that we can compare. There is no maximum that I'm aware of. Files are copied in chunks, so memory limitations aren't an issue.

But the destination folder must have enough space to hold the file you're copying. And the larger the file, the longer the file transfer process will take to complete. Chris, We are in the process of converting all the pc based sas users to 9. One of my users is used to loading, massaging,extracting a sas dataset which EG doen't do, so I'm trying your utility. I am the SAS Admin and have admin rights on my box.

I've downloaded SAS. CopyFiles71' or one of its dependencies. I just realized that I'm testing the 7. I went back to the 7. I will start testing it now. Which leads to the question will a 7. Thanks for all you work on the behalf of all of us out here in the field. Sometimes when this happens, it's because the DLL isn't loading from the place you think it is.

Near the beginning of the file, you'll find some mention of the SAS. The tool worked at the first try. Nice work there Chris. Thank you. Brunno, I don't have a 4. This works great and is now used by many in my organization. However, we often have the problem where 0 byte files are created on the destination server. Usually, when we re-run the task the download completes successfully the second time.

Occasionally, we need to re-run three or more times. We attribute this problem not to any bug in the task, but due to the fact that we have severe bandwidth problems connecting to the Unix server. Right now, we manually have to check the downloaded files and then manually re-run the task if needed.

Do you have any ideas how we might automate these manual steps? We should verify what's causing the file copy to fail. You can turn on additional logging using this technique. If you capture a log from a session where a copy operation fails, I might be able to see what's going on.

You can send me a note at chris. I've been using this successfully on EG 5. The system cannot find the file specified. Did you download the 7. And did you make sure that the 7. Ah, that's it, EG was still using the 5. I fixed and it is working as before. I have downloaded the latest version, and unblocked the. David, best way to install this is to drop it into the designated "Custom" folder for your version of EG, and not rely on the Add-In manager.

If you can turn on application logging and send me the log chris. Chris, I would greately appreciated some help on the following. I am trying to run the task but is giving me error:. Does the copy task have encryption to satisfy a secure transfer as our server is hosted on AWS and we need to ensure encryption in transit and at rest?

The task uses the same underlying SAS Integration Technologies connection to transfer the file content. That doesn't answer the "at rest" part of your question, but I guess you have that covered in your AWS environment. Hi Chris - I'm very glad you made this tool. I've been using it successfully since Today I just tried helping a colleague install it but no luck. We put the dll in the right place, but we don't see the add-in under tools.

Any troubleshooting you could recommend? Keith, be sure to unblock the DLL using these instructions. Hi there - thanks so much for the fast reply. We just tried that and it didn't work. Interestingly, the dll appeared to be blocked on my computer yet the add-in worked for me.

Any other thoughts? For my colleague, the add-in just doesn't appear. Other potential causes are using the wrong version of the DLL for the version of EG you have -- or having multiple versions "installed" instead of just the one that's appropriate. Hi - thanks again. We only have EG6. I tried to see how to get you the application logs for our version For example, I found the logging. So, I'm not sure where to copy the file.

You want the logging. Thanks a bundle for this very interesting tools. I would like to now if now it is possible to do it via a SAS code so it will be easy to use it trough a scheduled task.

You would have to find another method: FTP, network copy, or similar -- if you want to run in batch. There are uploading techniques, but your browser doesn't have permission to automate that step the way that a desktop app like EG would. You might need to come up with another technique in SAS Studio. You can post your specific needs to the SAS Studio discussion forum and see what ideas are shared. Wow, thanks! This worked great for transferring files my.

SAS script created to my shared network directory Thanks a lot for this amazing solution!!! We are migrating from PC to Server right now and moving files from our fileservers to the SAS server has turned out to be a nightmare.

Anyway, I have this question for you, Chris: is there a way to pass parameters to your CopyFiles task? Most of our users are still engaged in dealing with Excel, Access, Stata, etc.

Thanks again! Diego, you can pass parameters by using macro variables. Our Aim is to schedule the. Alternatives: you could use other shell script technologies to copy files between platforms, or use shared network locations to reference files in a place visible to both the PC and the server.

We are using plugin successfully. But want to know the backend sas code of the plugin. Is it possible? Pradeep - I'm glad it's working for you. You can't change them directly from this task, but your SAS admin can control the default permissions via a umask. Thank you very much Chris. We'll do some testing. I understand that changes according to the note, will affect on the whole session , not just the copy-files functionality. I have downloaded the add in and it works great.

I was wondering if there is a way of automating it. I created a task using Copy Files and linked it to a program in the process flow. When I run the program, it doesn't pick up the Copy files task to import the files from Windows. It works when I run it manually. This is new to me and I'm not sure what I'm missing here. Apologies if that's a repeated question. You can use the Ordered List tool to create a sequence of tasks that you want to run in a predefined order.

And these tasks can be placed across any of your process flows. I placed the file "SAS. If not, then you might need to still perform the Unblock step. Hi Chris your job is awesome and useful, but i have some questions: 1 How does this task interact between two sessions one remote and one local?

I see that macrovars can be used when defined in a program running on the remote session, but if i define a macrovar in a local sessione, then the copy task doesn't resolve them. The task resolves the macro variables only on one SAS session -- the one that is either the source or destination for the files you're copying.

That is, the server that's selected in the task. Currently the workaround is to use multiple Copy Files tasks. You can use a task template to make this easier. Once again using this in yet another EG project. One of the single most useful Custom tasks ever. Please keep making me look good. I have a process flow that utilizes the copy files task to move an excel document created via proc export from the SAS server to a local server.

I have found that if the proc export excel file exceeds a certain size, the copy files task loses the locations of the source and destination paths. It starts out knowing the source files to copy and where the destination folder is on the local drive, but once the process flow runs and the copy files task errors out, both of these prepopulated paths are blank.

Is there a limit to the size of a document that can be copied over? Is there a way to get around this? Meghan, there isn't a size limit that I've hit. Hi Chris, thanks for the great tool.

I have a question about the destination folder field. I am using SAS EG on a Citrix server, and I'm not sure the proper format in which to put a pathway into this filed so that any files that I upload through the tool are accessible in the general SAS workspace. How do I go about generating a destination folder? That really depends on the file system of your workspace server.

If you want to make the files available just for the current session, you can place them in your WORK folder. Use this as the destination value and check the "Resolve macro variables" checkbox:.

My question is how do you compare two datasets in two different unix data server using Proc Datasets or Proc Compare. Did you successfully assign the remote libname? Thanks a lot for all the help you do to everyone of us. I have written a sas script for sFTP upload using x command in sas. Its workingperfectly fine in sas 9. So my questions are.

Hi Chris thanks for reply. I am able to use x command for folder creation in EG, then why cant I use X command to execute Putty command. Below is the code which I am using. SAS has to decode that, and I'm not sure that this will happen with the X command. But When I run same code in sas 9. No error messege. Please help me, what is that preventing it to execute in sas EG? I don't know if that's what is happening here. Also, with a remote Windows, there might be a security interaction with network operations.

This copy file task works for only one folder at a time. I have 20 folders and in each of those 20 folders there are 30 different files, so what should I do in that case , do I have to run copy files task 20 times. Is there a solution for this problem, if there is any please let me know. You're correct. The Copy Files task can read from and write to only one folder. It's a limitation that keeps the task design simple It would look like this.

Check the table-of-contents with section links in the video description to navigate the video to the parts you need. Have a look and see if helps generate some ideas for you. I have used copy files task but is there a general way where we can straight away import using proc import and we don't have to do any copy files task. As this task is beneficial when the files are in same folder but what if files are in different folder. Is there a way where we can map a network drive and we can import any files from that drive.

The answer is probably No. For example, on a mapped drive in your Windows setup that can also be accessed from your machine that's running SAS. Can copy files task be executed through a code. Or Let's say we have process flow in which first thing is copy files task and then some program and we want to execute the whole process flow through the code.

So is there any way where we can execute a whole process flow so that it imports the file and then run the program without any manual intervention. The task runs within EG so if you run an entire process flow with the Copy Files task at the start, you're covered. But if the goal is create a batch SAS program that runs "unattended" without EG in the mix, you need another way to copy those files from place to place.

If right click them will it do the copy files task basically import the files and then run the program and so on so that within a single click the work is done. Yes, that's right. I have a question. If that column exist then do some operations and if not exist then do some operations.

I tried to look into internet but did not found anything that would always work. I found some snippet but it did work everytime. Yes, there are some helpful macros you can use. See this tip from the SAS community. Can similar thing be done in Process flow so that if I want to loop the process flow I just need to call it and loop it. Hi Aayush, no that's not supported. Hi, I used Copy file successfully, and then replicate it on other query and table returns blank on all the columns except the first column.

Column headers are all ok. Compared the column properties with a real file that i just manually brought into the query, they are exactly the same but why the columns return all blank except for the first column? Does copy file changes the attribute of the data? No, Copy Files performs a straight binary copy.

Is it the limitation of the task or my environment's setup? Save my name, email, and website in this browser for the next time I comment. How to copy files in bulk The Copy Files task supports two features that allow you to copy multiple files with a single step. Bruno on December 7, am. Early Christmas, thank you for this great tool Chris Reply. Bob Duell on December 22, am. This is a great enhancement, solving a big "usability" problem.

Jacob Keng on December 25, am. Chris Hemedinger on December 28, pm. Jacob Keng on January 2, am. Chris Hemedinger on January 2, am. Jacob, Are you referring to the 4. Jacob Keng on January 7, am. Chris Hemedinger on January 7, am. Jacob, I understand the problem Jacob Keng on January 7, pm. Chris Hemedinger on January 7, pm. Jacob Keng on January 9, pm. Jacob Keng on January 18, am. How Strange! Chris Hemedinger on January 18, am. Glad to hear that it's working for you.

Eren on January 4, am. This is an elegant tool! Thank You Chris. Roberto Lopez on January 23, pm. Do you think you can provide some insight? Chris Hemedinger on January 23, pm. Roberto Lopez on January 24, am. That worked!! Have to buy your book now :D! Tony on January 23, pm.

Tom on February 12, pm. Chris, Thanks for this! Chris Hemedinger on February 12, pm. Tom on February 22, pm. Overall, fabulous task! The forward slash should be okay, but maybe the spaces in the name are an issue. You have to make sure your target name doesn't contain the slash too. This can be problematic in certain environments. Renaming using Dos rename did preserve the datetime metadata, so that suggests that zipping the file then moving the zip file then extracting could work, but a test showed that "Date created" then became "Date modified", which in this case was older.

I extracted using 7zip, however Excel's row limit 1,, restricts the data. To get the full records, I'd like to read it to SAS, can you please help? Thank you. Yes, if the web site has an API for doing so. Save my name, email, and website in this browser for the next time I comment. Bruno's method has several advantages: It's coded as a SAS macro, so it is simple to reuse -- similar to a function.

It copies the file content in chunks rather than byte-by-byte, so it's more efficient. It provides good error checks and reports any errors and useful diagnostics to the SAS log. It's an excellent example of a well-documented SAS program! Mary Frank on September 18, am. I always enjoy your blog posts - very informative! Chris Hemedinger on September 18, am. Fred on March 17, am. Simon Ouellet on November 13, pm. Chris Hemedinger on November 13, pm.

Leo on June 1, pm. Chris Hemedinger on June 2, pm. Leo on June 3, am. As for terracopy, my work does not allow me to download other copy tools. Chris Hemedinger on June 3, pm. Active 6 years, 3 months ago. Viewed 9k times.

Improve this question. Allan Bowe Allan Bowe This macro will do the job: core. Add a comment. Active Oldest Votes. Improve this answer. Tom Quarendon Tom Quarendon 5, 5 5 gold badges 21 21 silver badges 28 28 bronze badges. Raw, you should now be able to mark your answer as correct - might want to as otherwise this looks like it's unanswered : Also, I'd suggest you add this to the FAQ as it's a commonly needed concept IMO, for a very limited definition of 'common'.

Done - thanks Joe - I kinda wanted to make sure there were no 'better' answers first though, as would feel kinda cheeky marking my own answer 'correct' if this was the case! Also - what are you referring to by 'add this to the FAQ'? I was referring to an inaccurate understanding of how FAQ worked : — Joe.

Richard Richard